-- Logs begin at Wed 2022-05-11 12:03:35 UTC, end at Wed 2022-05-11 13:15:33 UTC. -- May 11 12:37:23.811127 dv-cinder-837699-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 12:37:23.820804 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 12:37:23 2022] *** May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: nodename: dv-cinder-837699-4-iscsi May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: machine: x86_64 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: clock source: unix May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: pcre jit disabled May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: detected number of CPU cores: 4 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: current working directory: / May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: detected binary path: /usr/bin/uwsgi-core May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: your processes number limit is 47680 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: your memory page size is 4096 bytes May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: detected max file descriptor number: 2048 May 11 12:37:23.821754 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: lock engine: pthread robust mutexes May 11 12:37:23.822541 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: thunder lock: enabled May 11 12:37:23.822541 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 12:37:23.822541 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 12:37:23.868332 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: Python main interpreter initialized at 0x5566777289c0 May 11 12:37:23.868332 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: python threads support enabled May 11 12:37:23.868332 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: your server socket listen backlog is limited to 100 connections May 11 12:37:23.868332 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: your mercy for graceful operations on workers is 90 seconds May 11 12:37:23.868705 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: mapped 403077 bytes (393 KB) for 2 cores May 11 12:37:23.868775 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: *** Operational MODE: preforking *** May 11 12:37:23.869022 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: *** uWSGI is running in multiple interpreter mode *** May 11 12:37:23.869022 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: spawned uWSGI master process (pid: 91824) May 11 12:37:23.869256 dv-cinder-837699-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 12:37:23.869866 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: spawned uWSGI worker 1 (pid: 91838, cores: 1) May 11 12:37:23.870227 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: spawned uWSGI worker 2 (pid: 91839, cores: 1) May 11 12:37:23.873145 dv-cinder-837699-4-iscsi devstack@keystone.service[91824]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 12:37:29.643134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 12:37:29.643134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: from cryptography.utils import int_from_bytes May 11 12:37:29.643925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 12:37:29.643925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: from cryptography.utils import int_from_bytes May 11 12:37:29.644410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 12:37:29.644410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: from cryptography.utils import int_from_bytes May 11 12:37:29.645092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 12:37:29.645092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: from cryptography.utils import int_from_bytes May 11 12:37:29.693419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 12:37:29.693612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 12:37:29.693702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 12:37:29.693798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] command line args: [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 12:37:29.693884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 12:37:29.693993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] command line args: [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 12:37:29.694111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 12:37:29.694249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ================================================================================ {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 12:37:29.694341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 12:37:29.694423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ================================================================================ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 12:37:29.694500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] admin_token = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.694662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] admin_token = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.694757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] config_dir = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.694863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.694971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] config_dir = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] config_source = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] debug = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] config_source = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] debug = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.695904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_config_append = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_config_append = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.696983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_dir = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_file = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_dir = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.697942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.698952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.699937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.700924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] publish_errors = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] publish_errors = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.701912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.702927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] standard_threads = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] standard_threads = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] use_journal = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] use_journal = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] use_json = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] use_json = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.703991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] use_stderr = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] use_stderr = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] use_syslog = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] use_syslog = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 12:37:29.704649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.704740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.704885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.704975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.705889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.706940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.707895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.708871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.709865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.710999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.711950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.712945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.713122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.713249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.713901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.713980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.714891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.715964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.716895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.717114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.717313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.717524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.717719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.717922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.718920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.719964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.720864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.721999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.722942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.723870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.724967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.725947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.726985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.727897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.728838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.729557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.729646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.729819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.729923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.external = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.730875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.external = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.password = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] auth.token = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.731841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.password = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] auth.token = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.732950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.733924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.734956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.735921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.736939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737115 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.737922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.738868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.739984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.740940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.741990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.742914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.743846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.744888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.745966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.746997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.747974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.748920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.749867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.750967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.751997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.752920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.753898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.754984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.755995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.756860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.757904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.758845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.759807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.760925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.761068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.761151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769881 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.769955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.770990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] role.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] role.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.771968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] role.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] role.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.772949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.773929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774360 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.774949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.775765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.776927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.777993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.778902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.connection = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.779949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.connection = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.780987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.781995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 12:37:29.782225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 12:37:29.782438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91839) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 12:37:29.814018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.814191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.814277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.814431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.814537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.814663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.823824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.824084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.852351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.852574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.852719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.852952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.906136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.906398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.957558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.957783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.958489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:29.958727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.029482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.029707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.029922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.030999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.053949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.054902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.055027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.055110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.055236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.055322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.055453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.067034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.067470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.081500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.081725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.081889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.081975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91838) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.082990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.083204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91839) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 12:37:30.100260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.100466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 12:37:30.100674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.100796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.100881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 12:37:30.100995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 12:37:30.101237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.101321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.101461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 12:37:30.101548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.101718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.101800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.101980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.102071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.102236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.102492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.113540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.113812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.114893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.123142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.123607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.126412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.126685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.126931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.127029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.127944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.128926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.129007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.129209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.129306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.129480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.129746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.155877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.156708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.157509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.157786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.158321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.158603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.163017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.163294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.163571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.163944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.164225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.164506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.171369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.171647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.172639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.172923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.176233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.176514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.176791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.177085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.177357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.177573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.177658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.177861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.177957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.178124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.178206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.178405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.178680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.178952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.179223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.179497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.197218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.197489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.198832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.199111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.202110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.203600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.205707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.206000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.207236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.207534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.210908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.212487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.214699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.216181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.218393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.218690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.218972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.219249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.219519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.219790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.219908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.220209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.220496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.220781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.221077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.221361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.239167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.239535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.239801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.240062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.241059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.241447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.241721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.241989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.248568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.250314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.250586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.250670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.252344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.252622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.253657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.253933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.254212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.254496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.254772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.255712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.255997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.256280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.256567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.256842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.268556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.268832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.269136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.269428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.269704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.269990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.270262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.270573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.270853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.271134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.271422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.271702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.271985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.272261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.288252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.290397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.292163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.294330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.295498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.297104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.297664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.298713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.298987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.299264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.299349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.300899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.301219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.301511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.306670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.308866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.309729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.311343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.312087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.312379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.312660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.312932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.314600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.314895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.315180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.315463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.322126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.322425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.322764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.324802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.325102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.325394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.330729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91838) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.331008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.331284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.331554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.331821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.332102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.332378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.332651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.332918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.333226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.333325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91839) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 12:37:30.333495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.333579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.333766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.333848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91838) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.334843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.335120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.335397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.335675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.335945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.336220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.336484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.336740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91839) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 12:37:30.374073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5566777289c0 pid: 91838 (default app) May 11 12:37:30.376456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5566777289c0 pid: 91839 (default app) May 11 12:37:30.377392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d620aa-e2dd-4e5a-8aef-079f2b98f745 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:30.377693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d620aa-e2dd-4e5a-8aef-079f2b98f745 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:30.377977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d620aa-e2dd-4e5a-8aef-079f2b98f745 None None] PATH_INFO: `/v3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:30.382193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed May 11 12:37:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:39.315327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:39.315892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:39.315892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:39.320244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:37:39.326184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:39.326573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:39.326755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:39.357872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG oslo_db.sqlalchemy.engines [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 12:37:39.540109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG passlib.handlers.bcrypt [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91838) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 12:37:39.540525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG passlib.handlers.bcrypt [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91838) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 12:37:39.597057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:39.598696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:39.721523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 12:37:39.862847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:39.897005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG oslo_db.sqlalchemy.engines [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91839) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 12:37:40.024394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2f1d0-94b8-451b-bc5f-489d693f38b0 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:40.028729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:40.029421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:40.029712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:40.029992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:40.037997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:40.090475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 12:37:40.090818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a97ff3-06fe-4325-8bec-c496fb8b3898 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:40.100330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed May 11 12:37:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 12:37:40.106423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:40.120906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92c338-9931-4c5b-b6d5-8800127d1295 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:40.125227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:40.126337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:40.126624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:40.126901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] PATH_INFO: `/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:40.128464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] RBAC: Authorizing `identity:get_project(project_id=9ea94fb17e4549a0aa68e4ab8008eb33)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:40.178382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 12:37:40.178719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a9d6f-56ca-43f7-9f2a-5863f3894ff3 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:40.183877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed May 11 12:37:40 2022] GET /identity/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:42.494835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724737b-3a8b-4773-a88c-125423638a17 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:42.495389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724737b-3a8b-4773-a88c-125423638a17 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:42.495389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724737b-3a8b-4773-a88c-125423638a17 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:42.499522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:42.504916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:42.505329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:42.505513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:42.526260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:42.527974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:42.535846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 12:37:42.558848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724737b-3a8b-4773-a88c-125423638a17 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:42.570717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724737b-3a8b-4773-a88c-125423638a17 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:42.574929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:42.575562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:42.575853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:42.576134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:42.584939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:42.587366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c88458-6e3d-4ce0-ba41-656e76a55bba admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:42.607861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed May 11 12:37:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 12:37:42.613614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:42.622689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb7567-202e-4106-b7d8-7b160273c2b4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:42.627084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:42.628050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:42.628334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:42.628633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:42.630049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:42.631861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ad0bc-c580-4636-b656-dd1426865ff5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:42.633460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed May 11 12:37:42 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:44.909681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879ef4-0756-4366-af83-3a41f35714f8 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:44.910209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879ef4-0756-4366-af83-3a41f35714f8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:44.910209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879ef4-0756-4366-af83-3a41f35714f8 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:44.911602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:44.917280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:44.917683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:44.918012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:44.954503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adb65-c1d2-4db5-828f-b160385c5210 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:44.954693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adb65-c1d2-4db5-828f-b160385c5210 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:44.954979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2adb65-c1d2-4db5-828f-b160385c5210 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:44.956381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:44.962698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:44.963505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:44.963788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.013514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG passlib.handlers.bcrypt [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91839) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 12:37:45.013948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG passlib.handlers.bcrypt [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91839) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 12:37:45.048311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:45.049622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:45.061219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:45.062781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:45.127505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:45.151549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.162627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:37:45.185447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.247961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf40f6-4d3b-4f73-9898-dff25c23b798 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.280887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.281070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe4c5b-e37a-4cae-bd24-4fc7d54c6ccb None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.281725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.282013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.282293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.309379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:37:45.317826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.318733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.319021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.319299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:37:45.323146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:37:45.324066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:37:45.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:37:45.330025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.383903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.385802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.427517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ba3e-bf28-46d5-8a5e-db0bfd191cea None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.459353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.460018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.460305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.460584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.461368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:45.461678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.463720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.475167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:45.476513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:37:45.481304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.482280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.575036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415c505-8610-4019-bf14-ce01bc7a0b42 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.575494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f14800-6d4e-413c-8074-644324ba4e0d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.607499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.608286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.608570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.608846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.609410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.610281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.610568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.610843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.612042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.613532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.615153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:45.621006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.724215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b588b-b833-4f25-af52-f245c16526f6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.736308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.737819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.757925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.758719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:37:45.758822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:37:45.759740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:37:45.760790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:37:45.760790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:37:45.760790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:37:45.760790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:37:45.760995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.760995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.761141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:37:45.761213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.762332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.763924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:45.766031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.769485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:45.860886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25ce40-0629-41d3-a189-212c4ef8d9a2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.863859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260e48b-f5db-49a5-a3dc-2060e93d178d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:45.893919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.894575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.894865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.895147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.895872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:45.896184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.896519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:45.897202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:45.897489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:45.897616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cbf77-37e6-4460-a164-efff8f56fae0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.897765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:45.898601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.domain.id=default, user.id=23e04c3e033e439eb610ce935a77da73) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:45.898915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:45.900424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f62a6-94eb-4e85-ae7e-e8a869023ded None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:45.907146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/role_assignments?user.id=23e04c3e033e439eb610ce935a77da73&scope.domain.id=default&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:45.914989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:48.372183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210724a-5917-4c0b-8f48-08a38f270508 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:48.373134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210724a-5917-4c0b-8f48-08a38f270508 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:48.373617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210724a-5917-4c0b-8f48-08a38f270508 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:48.375517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:48.393959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325a24-d4bf-410e-8343-5e871075333b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:48.394479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325a24-d4bf-410e-8343-5e871075333b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:48.394559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325a24-d4bf-410e-8343-5e871075333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:48.415322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9a325a24-d4bf-410e-8343-5e871075333b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:48.417274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9a325a24-d4bf-410e-8343-5e871075333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:48.515278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:48.558184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210724a-5917-4c0b-8f48-08a38f270508 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:48.670157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210724a-5917-4c0b-8f48-08a38f270508 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:48.729716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:48.730524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:48.730806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:48.731071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:48.741386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-89a8d95f-c463-413e-bec4-49923ab27bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:37:48.749275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:37:48.750117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:48.750847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:37:48.751397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dab70-30e0-4f19-8faf-b0123c47711f None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:48.751397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dab70-30e0-4f19-8faf-b0123c47711f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:48.751397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dab70-30e0-4f19-8faf-b0123c47711f None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:48.752808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:37:48.754005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 13/25] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:37:48.761545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dab70-30e0-4f19-8faf-b0123c47711f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:48.771770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:48.772051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:48.772318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:48.808981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:48.809751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:48.969891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dab70-30e0-4f19-8faf-b0123c47711f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.002602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:49.034729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.035744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.036226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.036702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.037706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:49.038226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.039872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.040354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.061534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 13/27] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:49.067098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.222633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe974d-a7e9-44f3-b420-4ab3b91b1461 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.279226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca7b48-ea16-4fd4-9bdb-0c6a8bb3deb4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.290436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.291578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.292086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.292581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.309620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.312172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.340212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.343386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.348893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.349467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d968b493-5474-4fe4-81f3-a7b293ea86db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:37:49.351593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:37:49.352489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:37:49.353323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:37:49.353323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:37:49.353323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:37:49.353323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:37:49.355050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.356765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.359861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 15/28] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:37:49.361429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3086-d9b4-44cf-8bad-26445c064434 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.361895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:37:49 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:49.362436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3086-d9b4-44cf-8bad-26445c064434 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.362927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a3086-d9b4-44cf-8bad-26445c064434 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.364888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:49.367680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.370044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a3086-d9b4-44cf-8bad-26445c064434 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.524013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a3086-d9b4-44cf-8bad-26445c064434 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.525843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046ee1f-0ffa-4fc7-95cc-a182dc1275c3 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.559716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.560634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.561073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.561484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.562575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:49.563092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.564810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91521b02-7bd4-4b84-8d13-e8d4461d60e8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.567617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.568488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.568846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.569223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.571012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.573129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee671e-d5ff-4bed-a2a5-482ac50b2cca None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.574865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:49.576090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.576450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.576807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.587157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 17/32] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:49.589387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d48-7096-4a80-9565-99bffb6773d6 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.589881 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d48-7096-4a80-9565-99bffb6773d6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.590312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb9d48-7096-4a80-9565-99bffb6773d6 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.592638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 18/33] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:49.598107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9d48-7096-4a80-9565-99bffb6773d6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.600476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:49.601986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:49.693076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 16/34] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:49.693076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:49.734700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb9d48-7096-4a80-9565-99bffb6773d6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.772538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.773817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.774382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.774911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] PATH_INFO: `/v3/domains/default/users/23e04c3e033e439eb610ce935a77da73/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.777252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=23e04c3e033e439eb610ce935a77da73, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.778995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc4499-cd18-436f-8ca9-772eb36a4ae7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.808097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697dc56-e6ea-481f-852a-93352cc706a8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:49.842938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:49.843605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.843892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.844193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:49.844905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:49.846413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:49.983078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1361 bytes} [Wed May 11 12:37:49 2022] PUT /identity/v3/domains/default/users/23e04c3e033e439eb610ce935a77da73/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:37:49.985137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7370-9cc1-44d0-948f-8e78347792aa None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:49.985645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7370-9cc1-44d0-948f-8e78347792aa None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:49.986100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7370-9cc1-44d0-948f-8e78347792aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.006609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-719f7370-9cc1-44d0-948f-8e78347792aa None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:50.008293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-719f7370-9cc1-44d0-948f-8e78347792aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:50.045917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 17/36] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:37:49 2022] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:50.047374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:50.140852 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 20/37] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:50.145078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99725-4807-4942-8d24-281bb7ac578d None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.145078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99725-4807-4942-8d24-281bb7ac578d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.145078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99725-4807-4942-8d24-281bb7ac578d None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.157961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 21/38] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:50.163914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.164217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.164495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.196639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:50.198501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:50.230043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c91d-815e-453b-92a3-5eaa8bfb1244 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:50.271132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:50.271829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.272201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.272392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.273219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:50.275569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:50.288809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 22/39] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:50.289999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:50.390879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 18/40] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/roles => generated 219 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:50.391794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:50.401613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251af5-c929-408c-a95a-794e585444d6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:50.441736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:50.442672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.443124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.443554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.444601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:50.446417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518447f7-0b41-4ffe-88c2-9bce7aa05864 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:50.506708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2106ea-8ed0-481b-98df-64d927b344e0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:50.527646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 23/41] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/roles => generated 225 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:50.530224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e857-499a-4527-9ca2-b638810e58db None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.530727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e857-499a-4527-9ca2-b638810e58db None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.531558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e857-499a-4527-9ca2-b638810e58db None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.533501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 24/42] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:50.542095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.542738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.543440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.555597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:50.557437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.557845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.558149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.559311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:50.561542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:50.569123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:50.570716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:50.643097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 19/43] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/roles => generated 223 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:50.661180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 25/44] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:50.687308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:50.808319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2171c4c-d0f6-4407-94fe-2bada8ac5f5b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:50.846273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:50.847089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:50.847382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:50.847662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:50.849014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:50.850548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa641b7-39a2-44b8-b85b-cc76250a85fe None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:50.852694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 20/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:50.858602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:50.983799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6585-5947-4068-a4a3-eb861526cb95 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:51.018130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:51.018875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:51.019209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:51.019531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:51.020293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:51.021953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae5fa1-4598-4e3d-ad77-e4fdb5afea91 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:51.112828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 26/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:37:50 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:52.431578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f782-df6f-4d14-8495-01dbe0097b38 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:52.432187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f782-df6f-4d14-8495-01dbe0097b38 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:52.432187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375f782-df6f-4d14-8495-01dbe0097b38 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:52.433570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 21/47] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:52.438788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:52.439203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:52.439358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:52.456128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:52.457351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:52.521287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 27/48] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:52.544920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f782-df6f-4d14-8495-01dbe0097b38 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:52.642303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375f782-df6f-4d14-8495-01dbe0097b38 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:52.675331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:52.676156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:52.676505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:52.676851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:52.689057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:37:52.698748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:37:52.699768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:37:52.700519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 22/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:37:52.705941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:52.805450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4da656-7a52-4124-a4d2-e64b4fe25be4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:52.840190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:52.840868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:52.841194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:52.841482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:52.842239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:52.842555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:52.844062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:52.852325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 28/50] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:52.857850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:52.961356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1de9-ca63-4b9f-b7eb-078aa9cfbc0c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:52.995509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:52.996421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:52.996714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:52.997031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:52.998328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:52.999821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:53.001648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 23/51] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:37:52 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:53.007078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:53.103624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7281e1-d82d-43ee-bcba-af5fc0eef57c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:53.135995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:53.136747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.137072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.137340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.138503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:53.139966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e048855-9047-4f1f-bf3b-8765f1d51f67 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:53.141641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 29/52] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:37:53.147292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:53.247064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5eed8-0fe9-40e7-9afb-7cba7d551486 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:53.278336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:53.278993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.279281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.279592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.280390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.domain.id=default, user.id=23e04c3e033e439eb610ce935a77da73) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:37:53.280703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:53.282181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966219ec-9838-44df-893f-6d6621ece6b5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:53.291222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 24/53] 10.222.0.49 () {56 vars in 1322 bytes} [Wed May 11 12:37:53 2022] GET /identity/v3/role_assignments?user.id=23e04c3e033e439eb610ce935a77da73&scope.domain.id=default&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:53.377311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc74d-4994-4359-8780-9cc51c9b42c4 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.377680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc74d-4994-4359-8780-9cc51c9b42c4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.378004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bc74d-4994-4359-8780-9cc51c9b42c4 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.379469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 30/54] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:53.387029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.387321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.387603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.406152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:53.407938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:53.479960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 25/55] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:53.504276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bc74d-4994-4359-8780-9cc51c9b42c4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:53.604810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bc74d-4994-4359-8780-9cc51c9b42c4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:53.637262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:53.638051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.638337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.638614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.639780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:53.641252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67555217-c09a-40b5-afee-5c457db62e03 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:53.642875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 31/56] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:53.648450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:53.746197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e4136-f153-47f3-b563-03291bcccb17 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:53.778278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:53.778872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:53.779156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:53.779438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:53.780136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:53.781627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59e14d-6b98-48a7-96a6-ba443afb85d5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:53.882859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 26/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed May 11 12:37:53 2022] POST /identity/v3/projects => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:37:56.117374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb37f-0003-4ecf-80a4-454e0f8e6f72 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:56.117951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb37f-0003-4ecf-80a4-454e0f8e6f72 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:56.117951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb37f-0003-4ecf-80a4-454e0f8e6f72 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:56.119917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 32/58] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:37:56.125242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:56.125610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:56.125806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:56.143425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:37:56.144603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:37:56.208420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 27/59] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:37:56.233439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb37f-0003-4ecf-80a4-454e0f8e6f72 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:56.329939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb37f-0003-4ecf-80a4-454e0f8e6f72 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:56.361352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:56.362139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:56.362431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:56.362708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:56.363888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:56.365361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201b5b3-327c-4c91-b63c-e59e8f5649b1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:56.366972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 33/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:37:56.373495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:37:56.471901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3410f8b-b81a-4829-8945-37f00f9492ea None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:37:56.504645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:37:56.505332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:37:56.505619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:37:56.505893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:37:56.506593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:37:56.511184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81f09b-58f9-4696-a8ae-c4b4b3c294aa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:37:56.605635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 28/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:37:56 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:00.104614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a73c0-21c1-48e3-b344-b55fe3fe879f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.104614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a73c0-21c1-48e3-b344-b55fe3fe879f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.104614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a73c0-21c1-48e3-b344-b55fe3fe879f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.106049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 34/62] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:00.112369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.113381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.113887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.137978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:00.139198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:00.194063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2011a7-6477-4d48-b339-dbcaa11e6742 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.194761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2011a7-6477-4d48-b339-dbcaa11e6742 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.195239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2011a7-6477-4d48-b339-dbcaa11e6742 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.198063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 35/63] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:00.203794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.204320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.204809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.223026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:00.224584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:00.235167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 29/64] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:00.262583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.317236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 36/65] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:00.341248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.389008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06564-d3bf-497c-b7fe-f7622bf2e340 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.439072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.444283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.444801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.445260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.459227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-bc6e40b5-6d4e-46a1-8953-edbe9c5cc7be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:00.468400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:00.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:00.470482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:00.472637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 30/66] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:00.474111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731f84-c3cc-4b3a-9b66-850827af146a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.474637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731f84-c3cc-4b3a-9b66-850827af146a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.475130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8731f84-c3cc-4b3a-9b66-850827af146a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.476646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 31/67] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:00.483764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.484063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.484375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.486975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7adbb4-304c-44b0-9b38-c5e30e6735aa None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.503600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:00.504983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:00.526185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.527292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.527721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.528139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.538928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:00.547843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:00.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 37/68] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:00.556473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.583057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 32/69] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:00.584169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.669285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec223d5-bc93-4e4c-b08c-fed43fdd101a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.684179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8053b-5df7-4fc3-be50-f0f71091c5fd None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.705431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.706254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.706532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.706790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.707616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:00.707969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:00.709502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2649f-5c9f-44b7-ad55-56fb9c3c38bc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:00.720599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 38/70] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:00.720599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e274-97d6-49cc-836b-f26948e6e3cd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.720599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e274-97d6-49cc-836b-f26948e6e3cd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.720599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e274-97d6-49cc-836b-f26948e6e3cd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.725486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.725486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.725659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 39/71] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:00.725659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e274-97d6-49cc-836b-f26948e6e3cd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.728707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.729160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.729949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:00.730272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:00.732789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:00.747898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 33/72] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:00.747898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.831341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e274-97d6-49cc-836b-f26948e6e3cd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.842832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777262e6-d073-4266-80df-6a331fe06f79 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:00.863906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.864708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.864996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.865308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.874481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:00.875335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.875423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:00.875620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.875893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.877237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:00.878694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9a49a-a218-486a-b3bb-07811cd357a1 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:00.880577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 34/73] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:00.881632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf25d8-6938-4089-a4d3-49046d74d0d0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.881926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf25d8-6938-4089-a4d3-49046d74d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.882204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf25d8-6938-4089-a4d3-49046d74d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:00.883158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:00.884536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 40/74] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:00.890462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.905201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-72bf25d8-6938-4089-a4d3-49046d74d0d0 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:00.906406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-72bf25d8-6938-4089-a4d3-49046d74d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 35/75] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e3f7-493a-4565-95fc-95ff69791229 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e3f7-493a-4565-95fc-95ff69791229 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e3f7-493a-4565-95fc-95ff69791229 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 36/76] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:00.981105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04e3f7-493a-4565-95fc-95ff69791229 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:00.982761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2b2b8-4c50-4459-86b6-95dff231f1da None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.015766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.016642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.016927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.017240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.030722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.032168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.034097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 41/77] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.034684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.080711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04e3f7-493a-4565-95fc-95ff69791229 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.113073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.113787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.114076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.114359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.127998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e695f18-60cd-49e1-ab78-10664d96e326 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.160966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.161654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.161938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.162214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.162953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:01.163259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.164633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134def-c0b0-4744-8401-628443d21048 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.172590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 42/78] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.173791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.174081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.174359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.178913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.180519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.190388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:01.191638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:01.254987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 43/79] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:01.255731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.275865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 37/80] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:01.276834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.349533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bc69e-3ed8-40a7-bc46-0caea52c3563 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.370313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8948565-34df-447b-9d23-dda3709338c2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.382125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.382922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.383202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.383480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.393820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:01.402437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:01.403331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:01.404153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:01.404704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.404704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.404704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.404892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 44/81] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:01.404954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.405023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.470519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.472037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.503625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a26f47-3ea3-4d1f-8fc9-bcd7c7c812a5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.553577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.553577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.553577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.553577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.554022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.554022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.554022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 45/82] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.554022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.573622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 38/83] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:01.574466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.637764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb15a81-84bd-4c37-a3a8-4a6703ec52a3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.669718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.670577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.670862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.671145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.671492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627be1e-26f2-46ca-bbaf-49376d70d99f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.672343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.673822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.675527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 46/84] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.676277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.704578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.705406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.705696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.705975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.707140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.708595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.710275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 39/85] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.710275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.772249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aceb0-88b3-4fbc-b58b-80f00b0711a3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.804251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.804850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.805165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.805444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.806186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:01.806495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.807904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.808838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d7db-97c2-49ce-84fa-76c02e37bcad None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.815899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 47/86] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.816528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:01.843315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.843987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.844269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.844555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.908288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.909811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.912241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f737-37e1-4909-83b0-01f7ac32391a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:01.944878 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:01.945767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:01.946058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:01.946910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:01.948181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:01.949670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:01.951402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 48/87] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:01.952163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.003594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 40/88] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:02.004409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.046147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323bbd0-137f-47ad-95f2-f32fb31a1ce2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.078507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.079164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.079441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.079716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.080545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=23e04c3e033e439eb610ce935a77da73) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:02.080855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.082354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.087869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 49/89] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:01 2022] GET /identity/v3/role_assignments?user.id=23e04c3e033e439eb610ce935a77da73&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:02.090028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.098927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd2002-093c-4677-8045-806b71e9588d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.140162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.140842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.141165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.141742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.142180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.143683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.201618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf277e64-fbeb-4c1d-90c1-b00fe8752d09 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.236940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 41/90] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:02 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:02.237917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.238142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.238921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.239207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.239485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.240734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.242426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.249971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 50/91] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:02.249971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.356160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25c72-a7bc-4808-85ae-ae49b7fdfb07 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.370435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3c1e-a415-4d26-9f73-09c3f97aa0ec None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.393527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.394208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.394498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.394778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.395685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:02.395974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.397625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.409934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 42/92] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=fa903e57f2f4461fb91b94163f747824 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:02.411134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.417968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.419382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.419934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.420435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.423257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.424828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.426827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 51/93] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:02.433952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.536486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0cfa-e584-491e-8804-51e45bdb4237 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.547940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d724-6046-4e45-807d-673a5e21e26d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:02.574814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.575905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.576404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.576896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.590004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:02.590206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:02.590644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:02.590940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:02.591794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:02.592313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.594050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.601077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 52/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:02.677465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:02.678950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:02.805260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 43/95] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:02.813212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:02.940834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0628a-69f6-4ef5-add6-71e5582b355f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:03.001249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:03.002473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:03.002960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:03.003431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] PATH_INFO: `/v3/projects/e21f84e7407d42d4928215f84962f7ae` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:03.004888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] RBAC: Authorizing `identity:get_project(project_id=e21f84e7407d42d4928215f84962f7ae)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:03.006575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c841-b98e-42c2-bdc4-d9f12f56b997 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:03.008531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 53/96] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:02 2022] GET /identity/v3/projects/e21f84e7407d42d4928215f84962f7ae => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:03.015888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:03.134463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335274a-dd13-4c82-b40d-3e3ea89cd37e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:03.172461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:03.174007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:03.174492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:03.174978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:03.176008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=e21f84e7407d42d4928215f84962f7ae, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:03.176529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:03.178239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69618c5-f947-42cd-aa4d-978d555a1107 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:03.184586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 44/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:03 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=e21f84e7407d42d4928215f84962f7ae&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:05.310284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063060-029b-4592-8b48-6b02b10405f8 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.311321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063060-029b-4592-8b48-6b02b10405f8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.311804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6063060-029b-4592-8b48-6b02b10405f8 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.313518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 54/98] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:05.318789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a616e8-72e4-4294-ab1c-4a16062c3274 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.319177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a616e8-72e4-4294-ab1c-4a16062c3274 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.319337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a616e8-72e4-4294-ab1c-4a16062c3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.346029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-98a616e8-72e4-4294-ab1c-4a16062c3274 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:05.347531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-98a616e8-72e4-4294-ab1c-4a16062c3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:05.434775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 45/99] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:05.456878 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6063060-029b-4592-8b48-6b02b10405f8 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:05.591670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d1b8-0540-4163-9a2a-26a4f5e50761 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.592337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d1b8-0540-4163-9a2a-26a4f5e50761 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.592849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d1b8-0540-4163-9a2a-26a4f5e50761 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.594463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 46/100] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:05.599413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.599915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.600400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.652653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:05.654297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:05.706327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6063060-029b-4592-8b48-6b02b10405f8 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:05.760952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 47/101] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:05.790404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449968-e014-4a50-85f8-00883b165525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:05.791242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449968-e014-4a50-85f8-00883b165525 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.791526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449968-e014-4a50-85f8-00883b165525 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.791801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449968-e014-4a50-85f8-00883b165525 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.795509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:05.814858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80449968-e014-4a50-85f8-00883b165525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-80449968-e014-4a50-85f8-00883b165525 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:05.823523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:05.824414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:05.825211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 55/102] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:05.836457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449968-e014-4a50-85f8-00883b165525 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:05.952055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449968-e014-4a50-85f8-00883b165525 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:05.965330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caab57-6873-4f40-8a93-3c8707d10a82 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:05.987254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:05.987928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:05.988229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:05.988488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:05.989258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:05.989565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:05.990937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b11a5-3f83-41ed-8625-1929c2aed7bf None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:05.999393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 56/103] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:06.000830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464f31-a08d-47b1-b5c6-34cf352c7476 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.001287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464f31-a08d-47b1-b5c6-34cf352c7476 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.001725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04464f31-a08d-47b1-b5c6-34cf352c7476 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.003112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 57/104] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:06.004382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236afdf-0225-43de-a240-8b8246ee6ece None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.004834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236afdf-0225-43de-a240-8b8246ee6ece None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.005270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236afdf-0225-43de-a240-8b8246ee6ece None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.006329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.006920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 58/105] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:06.007181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.007472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.007754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.010329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ea739-b114-4e30-8859-2ba04bc94356 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.010837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ea739-b114-4e30-8859-2ba04bc94356 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.011326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ea739-b114-4e30-8859-2ba04bc94356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.020319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:06.028634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b20ea739-b114-4e30-8859-2ba04bc94356 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:06.029504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:06.030320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:06.031041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:06.031603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b20ea739-b114-4e30-8859-2ba04bc94356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:06.033516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 48/106] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:06.034716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.098113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 59/107] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:06.099645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.100087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.100515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.117117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:06.118536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:06.139719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290203c-37f4-4087-b49c-b7837aeba0be None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.176483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.177470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.177765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.178077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.179383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.181241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.183405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 49/108] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.184318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.194793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 60/109] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:06.196761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.288129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d66e2c-081c-4111-9dda-08b2ef52c04c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.299804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777e56-7184-4216-b41f-3ca999fc100f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.326391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.327071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.327364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.327647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.328428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:06.328712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.330161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.340020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.341439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.341891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.342372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.344616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 50/110] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.345650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.355940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:06.364018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:06.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:06.365671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 61/111] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:06.366300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.450003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb0ff9-923e-4713-bfab-913ca53a879f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.476508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c73335-e805-4265-8012-587c945c9d0a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.483863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.484729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.485014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.485319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.486501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.487949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.489821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 51/112] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.490578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.512670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.513506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.513794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.514071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.515241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.516697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faebcaa-6434-4bc6-a3cf-80c6643e53f4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.518374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 62/113] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.519535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dbcc-4907-4d56-9468-afbc3deff9c4 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.519823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dbcc-4907-4d56-9468-afbc3deff9c4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.520104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993dbcc-4907-4d56-9468-afbc3deff9c4 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.521391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 63/114] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:06.522084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993dbcc-4907-4d56-9468-afbc3deff9c4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.591924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c38b77-a2c6-4b65-94e6-3e26e8756907 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.618754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993dbcc-4907-4d56-9468-afbc3deff9c4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.623675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.624567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.624852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.625152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.626338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.627771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351fc0e-0ecc-4b80-9682-0032c79b8252 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.629457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 52/115] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.630606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a83c-a933-4308-b4c6-48d59d0c8761 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.630888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a83c-a933-4308-b4c6-48d59d0c8761 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.631161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566a83c-a933-4308-b4c6-48d59d0c8761 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.632396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 53/116] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:06.637214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566a83c-a933-4308-b4c6-48d59d0c8761 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.655618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.656296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.656595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.656882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.657661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:06.657976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.659354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.668155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 64/117] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:06.668943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.736690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566a83c-a933-4308-b4c6-48d59d0c8761 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.765742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa9e1a-0e76-4602-b5e5-4409e103ff4e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:06.772442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.773367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.773654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.773931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/fd24ac751a004d07a90e60d34f0abc75/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.776371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, user_id=fd24ac751a004d07a90e60d34f0abc75, role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.777860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec049d1a-1c87-4435-9e38-0dde62e24576 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.798471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:06.799133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.799421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.799702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.804553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:06.804553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:06.884402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 54/118] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:06 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/fd24ac751a004d07a90e60d34f0abc75/roles/fa903e57f2f4461fb91b94163f747824 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:06.885918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587495e2-961c-4eb3-803c-9a38a439a1b2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.886207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587495e2-961c-4eb3-803c-9a38a439a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.886489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587495e2-961c-4eb3-803c-9a38a439a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:06.903844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-587495e2-961c-4eb3-803c-9a38a439a1b2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:06.905101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-587495e2-961c-4eb3-803c-9a38a439a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:06.934901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 65/119] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:38:06 2022] POST /identity/v3/projects => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:06.934901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:06.997799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 55/120] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:06.999229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:06.999530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:06.999869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.031518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:07.033558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:07.094514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a1f5b-28d2-435c-acb3-2fa545589288 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.119058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 56/121] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:07.120359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.145862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.147320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.147713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.148372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.149985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.152108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.154695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 66/122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:06 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.155876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.244795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712dcf-5cb4-4fa7-82be-54f9b2b26978 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.276825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c4773-1ffa-406b-9653-2141e4265c03 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.288992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.290882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.291172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.291815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.293361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.295335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.297754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 57/123] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.298549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.311449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.312341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.312694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.313060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.323940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:07.331795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:07.332713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 67/124] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:07.334605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.406150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d992-4cf3-4b56-bdcc-ba7f714be599 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.434435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b406-bd66-4a79-aef1-bcb7b7d69074 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.441711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.442555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.442920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.443240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.455071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:07.463009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:07.465201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 58/125] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:07.467113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.472967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.472967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.472967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.472967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/23e04c3e033e439eb610ce935a77da73/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.475926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, user_id=23e04c3e033e439eb610ce935a77da73, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.475926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.574958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb74-e98c-499f-a9af-93e853a170d6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.575550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 68/126] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:07 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/23e04c3e033e439eb610ce935a77da73/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:07.576694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.629865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.632038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.632330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.632612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.635322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.636791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.642899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 59/127] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.643849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.777983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da7b56-e9f5-4a43-aa23-57f302078839 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.799196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb30255-6b28-4547-81f0-3aa8a9fb8ac9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.822928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.823612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.823895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.824169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.824920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:07.825254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.826806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.837385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.838074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.838367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.838654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.839423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:07.839526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 69/128] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.839740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.840338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.841343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.851606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 60/129] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.852346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:07.955331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916fe52-c1d6-4ee4-bcc5-7addc430078a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.967543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ac158-35f5-4397-a127-fe2275333999 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:07.989382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:07.990262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:07.990600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:07.990886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:07.992177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:07.994335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:07.996021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 61/130] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:07.996789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:08.044609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.045545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.045827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.046101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/fd24ac751a004d07a90e60d34f0abc75/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.054449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, user_id=fd24ac751a004d07a90e60d34f0abc75, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.056663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.096599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d5940-e90c-4e88-90cd-db095ececbaa None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:08.130479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.131362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.131653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.131935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] PATH_INFO: `/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.150385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] RBAC: Authorizing `identity:get_user(user_id=f4aa0e1d7b304cb69fc6dcf54478bbe3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.151920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.153429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 70/131] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:07 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/fd24ac751a004d07a90e60d34f0abc75/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:08.153740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 62/132] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:07 2022] GET /identity/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:08.154645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:08.160115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:08.343263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da30e1c-86c8-458d-96fd-6d199030258c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:08.351735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5620-1a07-423d-b609-3c1349be8a4d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:08.377905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.378796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.379085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.379389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] PATH_INFO: `/v3/projects/e21f84e7407d42d4928215f84962f7ae` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.380674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] RBAC: Authorizing `identity:get_project(project_id=e21f84e7407d42d4928215f84962f7ae)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.382071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.384378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 71/133] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:08 2022] GET /identity/v3/projects/e21f84e7407d42d4928215f84962f7ae => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:08.393064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:08.396591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.397293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.397584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.397863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.512542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.514071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.553314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f6ae7-b1bc-44d4-b692-ad5887c1d915 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:08.596927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.598638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.598764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.599214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] PATH_INFO: `/v3/projects/e21f84e7407d42d4928215f84962f7ae/users/fd24ac751a004d07a90e60d34f0abc75/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.601376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=e21f84e7407d42d4928215f84962f7ae, user_id=fd24ac751a004d07a90e60d34f0abc75, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.603021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.634192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 63/134] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:08.642093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:08.686038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 72/135] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:08 2022] PUT /identity/v3/projects/e21f84e7407d42d4928215f84962f7ae/users/fd24ac751a004d07a90e60d34f0abc75/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:08.799121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2013762-c786-4bc0-8046-ead74fe80f03 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:08.858752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:08.859944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:08.860413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:08.860872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:08.862384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:08.864267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd133c4-4160-4fb4-be08-8df9e31218cd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:08.866568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 64/136] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:08 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:08.874151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:09.015856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b96fa-ee8d-4805-8df8-9fcbf75a2c93 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:09.063013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:09.063691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.063975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.064256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:09.065116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=f4aa0e1d7b304cb69fc6dcf54478bbe3) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:09.065438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:09.066909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a696b5-8968-4c32-8a2c-b7a903eec0ac None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:09.077580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 73/137] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:08 2022] GET /identity/v3/role_assignments?user.id=f4aa0e1d7b304cb69fc6dcf54478bbe3&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=270e8661915e4bc3b532d58abc839627 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:09.678554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77617fa-1ba8-4d74-b3b6-6effbed7d218 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.679092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77617fa-1ba8-4d74-b3b6-6effbed7d218 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.679092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77617fa-1ba8-4d74-b3b6-6effbed7d218 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:09.681006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 65/138] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:09.691471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892209-e9c2-40dd-a2f3-4cb0ae44fc1e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.692247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892209-e9c2-40dd-a2f3-4cb0ae44fc1e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.692670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892209-e9c2-40dd-a2f3-4cb0ae44fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:09.710526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-1f892209-e9c2-40dd-a2f3-4cb0ae44fc1e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:09.717665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1f892209-e9c2-40dd-a2f3-4cb0ae44fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:09.785592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 74/139] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:09.809538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77617fa-1ba8-4d74-b3b6-6effbed7d218 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:09.846559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198297bb-b8f6-4a06-9ad6-f560b462c03f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.847169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198297bb-b8f6-4a06-9ad6-f560b462c03f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.847664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198297bb-b8f6-4a06-9ad6-f560b462c03f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:09.849278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 75/140] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:09.857222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.858060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.858547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:09.886224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:09.887430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:09.921800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77617fa-1ba8-4d74-b3b6-6effbed7d218 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:09.995281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:09.996497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:09.997059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:09.997721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.016448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:10.031538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:10.032404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:10.033185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:10.035840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 66/141] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:10.042808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:10.062614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 76/142] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:10.104037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:10.153480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742437d6-f20e-4ac2-8653-734d08fac3e1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:10.196977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:10.198042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:10.198526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:10.198998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.200040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:10.200593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:10.206323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:10.221336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 67/143] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:10.223057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:10.388993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75573a-dc4d-44ff-bf25-d11af59b847d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:10.417514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde3f7-57a8-44a0-b9b0-e8201f30ece1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:10.470675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:10.471519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:10.471779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:10.472057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.477798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:10.479257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:10.481400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 77/144] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:10.490325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:10.490727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:10.491635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:10.491921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:10.492204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.493606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:10.495149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:10.496821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 68/145] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:10 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:10.502567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:10.698705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b00b6-9f18-439a-834b-dc7dd8c38a93 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:10.743825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda0222-bca1-4a25-8cad-21730faedbf5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:10.758361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:10.759057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:10.759344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:10.759635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.760679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:10.762175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:10.816819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:10.817533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:10.817823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:10.818105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:10.895927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 78/146] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:10 2022] POST /identity/v3/users => generated 283 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:10.918174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:10.920108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fdccd-47ec-4ea0-9aeb-ff2cd492b9ef None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:11.051503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 69/147] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:11.057816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.137885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a549c-14e0-4d5e-8fb1-09b1730256c2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.138205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a549c-14e0-4d5e-8fb1-09b1730256c2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.138462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a549c-14e0-4d5e-8fb1-09b1730256c2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.140033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 70/148] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:11.154189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.154519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.154756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.182663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:11.186670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:11.231158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2044-c727-49f2-90e6-290d3502db04 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.271550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 71/149] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:11.291363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.292561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.293081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.293550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.295039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:11.296829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:11.298849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 79/150] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:11.304873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.314507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.433277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dee1ea-2c4f-4ae5-b572-9609c8f1fa14 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.472169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.473352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.474239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.474754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.486235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:11.495473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:11.496306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:11.497433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:11.500693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 80/151] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:11.506661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.507189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b390c-98f0-4d53-a617-5efff4c30508 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.572365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.573773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.579528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.580064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.581291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:11.582252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:11.584057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632697c-dcc9-4260-8b26-dd0abe070ad8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:11.599155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 72/152] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=fa903e57f2f4461fb91b94163f747824 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:11.644134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0dc48-815b-47f6-b3b6-b400de245ec1 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.644763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0dc48-815b-47f6-b3b6-b400de245ec1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.645314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0dc48-815b-47f6-b3b6-b400de245ec1 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.646958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 73/153] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:11.654880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.655493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.655993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.667512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92c037-515b-4434-9dcc-b500ff56f57f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.679216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:11.683169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:11.703227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.703916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.704198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.704547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.705291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:11.705605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:11.707005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:11.718000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 81/154] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:11.726212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.779007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 74/155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:11.802742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.887406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159fdcb-0131-40bd-9c61-2fee12a5a1d5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.914990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd1250-a1c2-4a85-87c7-cb9c58ccd5c7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:11.952055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.953228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.953738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.954211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.965458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:11.973628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:11.974462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:11.975192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:11.978286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 75/156] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:11.983949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:11.984423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:11.984846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:11.985152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:11.985431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] PATH_INFO: `/v3/users/23e04c3e033e439eb610ce935a77da73` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:11.989890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=23e04c3e033e439eb610ce935a77da73)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:11.991264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:11.993764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 82/157] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/users/23e04c3e033e439eb610ce935a77da73 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:11.999582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.090400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c40-2532-47c7-8bc8-a2560f191635 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.125674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.126697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.127196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.127806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.128826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:12.129365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.130996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.140649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 76/158] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:12.146387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.251286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bc9eb-7b7d-41bc-bf15-38c682706ba8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.255629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c23e1f-c2a6-4bf7-9118-6442737b6531 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.291445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.292700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.293235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.293709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.295169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.296927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.298921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 77/159] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:12.304540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.338849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.339518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.339801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.340069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.414167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb48b5-efa9-4d1c-88bd-1be766f4d027 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.451280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.452370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.452874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.453365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.506108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.507675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22262eb5-a4ba-4f78-b2e6-fd1d8f5b2086 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.526814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.529750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebe7c7-c41f-46d5-8797-fedaa96d4a7a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.631441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 78/160] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:38:12.637063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8c33-fe0c-48f4-b345-ce9b3d3c7ab3 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.637611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8c33-fe0c-48f4-b345-ce9b3d3c7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.638088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db8c33-fe0c-48f4-b345-ce9b3d3c7ab3 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.639946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 79/161] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:12.641992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8c33-fe0c-48f4-b345-ce9b3d3c7ab3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.697244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 83/162] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:38:12.698603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fed0e-3794-45fa-aad0-18d49e94b3e3 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.698850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fed0e-3794-45fa-aad0-18d49e94b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.699187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fed0e-3794-45fa-aad0-18d49e94b3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.716871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ce3fed0e-3794-45fa-aad0-18d49e94b3e3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:12.718112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ce3fed0e-3794-45fa-aad0-18d49e94b3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:12.757159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db8c33-fe0c-48f4-b345-ce9b3d3c7ab3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.787916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 84/163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:12.789565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc34d4-5b14-4ce1-882f-c4f9057367f9 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.789863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc34d4-5b14-4ce1-882f-c4f9057367f9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.790289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc34d4-5b14-4ce1-882f-c4f9057367f9 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.792081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 85/164] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:12.792599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.793087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc34d4-5b14-4ce1-882f-c4f9057367f9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.793543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.793827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.794166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.797776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.799343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9675-5de7-447d-8484-227afb3d36cd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.801400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 80/165] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:12.802628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.803293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.827798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:12.828993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:12.900992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 81/166] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:12.901892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:12.906751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc34d4-5b14-4ce1-882f-c4f9057367f9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:12.951492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:12.952665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:12.952665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:12.953184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:12.954389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:12.956141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:12.957793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 86/167] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:12.958379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.059272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e79089-65ec-48c2-ad04-64cebd3015da None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.085133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434efca-b63c-4069-b4f8-927edfe6b923 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.094305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.095120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.095408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.095686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.106198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:13.113974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:13.114817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:13.115571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 87/168] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:13.116693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.181763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.182435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.182715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.182984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.183973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:13.184286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.185858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.203506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 82/169] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:12 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.204100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.222971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c04653-8e8d-41ac-8f66-81e14f9d5aa1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.259645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.260742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.261030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.261332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.272746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:13.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:13.283804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 88/170] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:13.285759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.390298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0e311-89d4-4101-ae36-0c1c2dab9d31 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.425735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.426420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.426708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.426988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.427755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:13.428067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.429525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.439622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 89/171] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.440490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.502589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c208602-eab5-4416-8419-94d6511c0ee2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.547319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d8bd-a3c1-4e5f-9e18-eb86792ca8c8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.583336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.584022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.584307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.584584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.585395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:13.585818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.587920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.593767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.595818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.595818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.595818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.596235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=23e04c3e033e439eb610ce935a77da73) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:13.596235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.597681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.600502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 90/172] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.601360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.611454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 83/173] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/role_assignments?user.id=23e04c3e033e439eb610ce935a77da73&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.612313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.717076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bd094-b258-4ceb-9862-04eee3057ffb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.772840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511257-1a30-4085-9891-9362fd4614c6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.798644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.799995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.800588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.801128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] PATH_INFO: `/v3/users/fd24ac751a004d07a90e60d34f0abc75` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.804645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] RBAC: Authorizing `identity:get_user(user_id=fd24ac751a004d07a90e60d34f0abc75)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.806660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.808659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 91/174] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/users/fd24ac751a004d07a90e60d34f0abc75 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.810842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.811771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.812052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.812328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] PATH_INFO: `/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.813723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f4aa0e1d7b304cb69fc6dcf54478bbe3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.814890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.815373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.817096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 84/175] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:13.823653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:13.945334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1e357-90df-4040-bde9-605a7b13b5f9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:13.983656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:13.984523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:13.985290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:13.985570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:13.987531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:13.989425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:13.991783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 85/176] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:13.998662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:14.034127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc44b7-97a4-4e17-bd78-dc982b5c5e0d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:14.125790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:14.126468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.126761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.127045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.153329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b30bc-3fe2-4115-8b2a-9a0e5673d7a7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:14.192215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:14.193202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.193482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.193751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/f4aa0e1d7b304cb69fc6dcf54478bbe3/roles/270e8661915e4bc3b532d58abc839627` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.196479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, user_id=f4aa0e1d7b304cb69fc6dcf54478bbe3, role_id=270e8661915e4bc3b532d58abc839627)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:14.198350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:14.240158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:14.242011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:14.282741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 86/177] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:13 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/users/f4aa0e1d7b304cb69fc6dcf54478bbe3/roles/270e8661915e4bc3b532d58abc839627 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:14.367093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 92/178] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:14.374182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:14.489366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfe091-a4f2-4de7-af30-e9f36306aa07 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:14.536162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:14.537405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.537865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.538340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] PATH_INFO: `/v3/projects/e21f84e7407d42d4928215f84962f7ae` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.540274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] RBAC: Authorizing `identity:get_project(project_id=e21f84e7407d42d4928215f84962f7ae)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:14.542134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd81a26c-489a-4821-a7d1-edc1ee6d4617 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:14.544364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 87/179] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:14 2022] GET /identity/v3/projects/e21f84e7407d42d4928215f84962f7ae => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:14.553082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:14.698502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416d07-677e-40cc-982b-560e4b312fbd None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.699070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416d07-677e-40cc-982b-560e4b312fbd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.699533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09416d07-677e-40cc-982b-560e4b312fbd None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.701078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 88/180] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:14.707045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.707470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.707849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.711648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdaf18-af18-4fbb-a7e2-d2445352f8d3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:14.731551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:14.732888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:14.768447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:14.769135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:14.769473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:14.769754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:14.770618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=e21f84e7407d42d4928215f84962f7ae, user.id=fd24ac751a004d07a90e60d34f0abc75) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:14.770909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:14.773184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:14.784292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 93/181] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:14 2022] GET /identity/v3/role_assignments?user.id=fd24ac751a004d07a90e60d34f0abc75&scope.project.id=e21f84e7407d42d4928215f84962f7ae&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:14.821764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 89/182] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:14.845524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:14.968252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38789-881c-4468-9085-4793b12c3182 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.019312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.020190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.020474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.020749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.032863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:15.041079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:15.041993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:15.042739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 94/183] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:15.049266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.174154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cf4d8-db9e-432d-b0c6-49a46c5aafa6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.214361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.215041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.215390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.215662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.216472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:15.216786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:15.218201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec7705-4985-4f48-9d9b-7b0c8898ac99 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:15.229154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 90/184] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:15.234683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.314374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915654-d524-4a54-ad6c-24f7564e9a1d None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.314716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915654-d524-4a54-ad6c-24f7564e9a1d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.314940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e915654-d524-4a54-ad6c-24f7564e9a1d None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.316329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 91/185] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:15.323211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.323532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.323814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.342223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:15.343457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:15.344341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a44cfc-4edf-4187-9655-37b1663409ee None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.383862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.384753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.385392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.385671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.403366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:15.404847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:15.406632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 95/186] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:15.414224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.414929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 92/187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:15.439833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.532092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fec26-6cac-40c5-aeec-ca2899e84672 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.547150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449539ad-3ad7-486b-8244-c65e4e6ab848 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.560625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.561338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.561623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.561900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.592294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.594998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.595279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.595559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.610752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:15.624528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:15.626605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:15.627380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 93/188] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:15.635898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.662153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:15.665185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea679c-e482-4670-80a8-57e115d143c9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:15.745136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2aab-37c2-485c-9cb0-41d8bffefbeb None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.777198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 96/189] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:38:15.779272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113790-78c3-4e74-96ed-b57709f3553d None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.779778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113790-78c3-4e74-96ed-b57709f3553d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.780349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113790-78c3-4e74-96ed-b57709f3553d None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.781377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.782050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.782388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.782613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.782847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 97/190] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:15.783373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:15.783686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:15.784171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113790-78c3-4e74-96ed-b57709f3553d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.785088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a7454-4119-40ee-bd92-2c1f4686a313 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:15.794790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 94/191] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:15.796090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.796406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.796743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.813798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:15.815117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:15.886472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 95/192] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:15.890161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:15.902635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113790-78c3-4e74-96ed-b57709f3553d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:15.943985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:15.944856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:15.945170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:15.945444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:15.947508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:15.949212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:15.952789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 98/193] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:15.952789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.012263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6247a3-17a9-4dc3-ab13-23fa38da3b69 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.046014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.046808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.047092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.047367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.048574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.050040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.056514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 96/194] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:16.056514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.058934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247799c-0cac-428e-8489-e8446eccf568 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.097138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.097936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.098221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.098506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.099668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.101154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.102989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 99/195] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:16.103754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.158709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafb74-25bb-46e9-8fb4-eb3c7775b746 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.192622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.193437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.193834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.194164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.195187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=59483d81590d4d23bd2930708c9a6d97) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:16.196124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.197641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.201743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90b2f2-abdd-45d8-86d8-6811f5cad426 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.203482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 97/196] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:16 2022] GET /identity/v3/role_assignments?user.id=59483d81590d4d23bd2930708c9a6d97&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:16.204348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.252211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.253911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.254200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.254481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.342830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95893766-cfa6-4fe2-adb8-fb6b3370d312 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.347187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.348726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.383614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.384644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.385406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.385905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.386843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.388309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.460686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 100/197] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:16.465919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.507348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 98/198] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:16 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:16.592293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c037d34-d63c-4b2d-9365-7270964e69ef None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.629588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.630432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.630717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.630993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.632316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.634678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2106-dc1a-4388-a6d3-ad2515a7cf51 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.637540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 101/199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:16 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:16.644914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:16.760942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df49209-3523-4fbc-a627-4dc65ec0b509 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:16.795580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:16.796250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:16.796539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:16.796821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:16.797702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=59483d81590d4d23bd2930708c9a6d97) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:16.798021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:16.799485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac8035-678c-41a8-a1ab-496970a34213 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:16.808283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 99/200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:16 2022] GET /identity/v3/role_assignments?user.id=59483d81590d4d23bd2930708c9a6d97&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=fa903e57f2f4461fb91b94163f747824 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:17.070341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df645-f250-4fb3-9fb3-2c952ee4557a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.071848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df645-f250-4fb3-9fb3-2c952ee4557a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.071848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df645-f250-4fb3-9fb3-2c952ee4557a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.073050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 102/201] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:17.078379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.078777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.078977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.097144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:17.098343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:17.166063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 100/202] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:17.189309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df645-f250-4fb3-9fb3-2c952ee4557a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:17.293344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df645-f250-4fb3-9fb3-2c952ee4557a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:17.328679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:17.329515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.329797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.330074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.341007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:17.348692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:17.350745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:17.352919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 103/203] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:17.357069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:17.458446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78806138-1e7f-4fe6-8758-33df85d03b63 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:17.492894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:17.493591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.493878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.494154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.494901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:17.495207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:17.496603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:17.505256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 101/204] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:17.511735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:17.615007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b358-fd14-48be-ad34-c129b48ed048 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:17.650098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:17.651147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.651577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.651855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] PATH_INFO: `/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.662429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f4aa0e1d7b304cb69fc6dcf54478bbe3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:17.663916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:17.665697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 104/205] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:17 2022] GET /identity/v3/users/f4aa0e1d7b304cb69fc6dcf54478bbe3 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:17.671693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:17.810334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285960c-7485-416c-a83b-3d46fc817b33 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:17.848239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:17.848893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:17.849211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:17.849489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:17.918637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:17.920031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:18.019474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 102/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:18.025203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:18.126041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2e1ce-35be-452d-8f86-9f90a465a4e4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:18.159339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:18.160202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:18.160484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:18.160760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:18.162004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:18.163468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ac94a-1d8f-4608-950f-ed54aad35927 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:18.166160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 105/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:18 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:18.171927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:18.271326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3872e-ab7a-4dfd-804a-e310aaf99083 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:18.321916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:18.322573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:18.322859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:18.323136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:18.323973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, scope.project.id=22c5658eb7fb4c758ff6cac952410994, user.id=f4aa0e1d7b304cb69fc6dcf54478bbe3) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:18.324300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:18.325820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6962d-5323-4b7e-b176-83c51e4ceab8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:18.337961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 103/208] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:18 2022] GET /identity/v3/role_assignments?user.id=f4aa0e1d7b304cb69fc6dcf54478bbe3&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=270e8661915e4bc3b532d58abc839627 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:18.863676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2ebe1-a799-4f2a-a60e-6d889d429e11 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:18.864063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2ebe1-a799-4f2a-a60e-6d889d429e11 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:18.864233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2ebe1-a799-4f2a-a60e-6d889d429e11 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:18.865900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 106/209] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:18.871896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:18.872194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:18.872479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:18.890415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:18.891595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:18.968172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 104/210] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:18.991458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2ebe1-a799-4f2a-a60e-6d889d429e11 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.104818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2ebe1-a799-4f2a-a60e-6d889d429e11 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.139534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.140335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.140620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.140895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.152279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:19.160159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:19.162497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:19.165154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 107/211] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:19.168055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.278930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c53da-f4b2-4c98-9e61-a4d542e7d400 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.317404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.318435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.318900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.319379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.320387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:19.320899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:19.322528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:19.337228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 105/212] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:19.339847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.445873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b01ed-e347-44b3-9965-9c7a244cd939 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.481223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.482406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.482865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.483353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.484882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:19.486551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0904-05d9-42ee-8fda-d6aed404ac64 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:19.488516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 108/213] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:19.494966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.495487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa451b-d023-4b3d-8aba-e7e725c5ac78 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.495779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa451b-d023-4b3d-8aba-e7e725c5ac78 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.496060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa451b-d023-4b3d-8aba-e7e725c5ac78 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.497848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 109/214] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:19.503564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa225-2677-4284-90c4-696f86ac399c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.503870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa225-2677-4284-90c4-696f86ac399c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.504126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffa225-2677-4284-90c4-696f86ac399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.524394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e2ffa225-2677-4284-90c4-696f86ac399c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:19.526261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e2ffa225-2677-4284-90c4-696f86ac399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:19.597325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 110/215] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:19.599048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b8cc-460c-4a1a-8416-9fe1df30e896 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.599342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b8cc-460c-4a1a-8416-9fe1df30e896 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.599621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b8cc-460c-4a1a-8416-9fe1df30e896 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.600903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 111/216] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:19.606823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.607108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.607386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.623630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1253d4f-2845-40f2-888e-b259711d884d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.623800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:19.624907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:19.657522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.658468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.658758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.659130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.660346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:19.661833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:19.663567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 106/217] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:19.664970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.699772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:19.700608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.768487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b81cf-1c8f-4dd0-8646-0f80a272c41e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.796526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777c91-6f15-4962-b08a-4871ffd522fb None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.799896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.800698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.800982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.801292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.811644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-d5d7b172-8fc8-4eef-9eef-1db608fdd5cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:19.819648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:19.820723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:19.821546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 107/219] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:19.822376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b7d3-b3d9-458e-84ec-e328719efb11 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.822376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b7d3-b3d9-458e-84ec-e328719efb11 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.822711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b7d3-b3d9-458e-84ec-e328719efb11 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.823942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 108/220] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:19.824627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b7d3-b3d9-458e-84ec-e328719efb11 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.836824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.837748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.838026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.838294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/59483d81590d4d23bd2930708c9a6d97/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.840227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, user_id=59483d81590d4d23bd2930708c9a6d97, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:19.841707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:19.921852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b7d3-b3d9-458e-84ec-e328719efb11 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:19.947003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 113/221] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:19 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/59483d81590d4d23bd2930708c9a6d97/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:19.947901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:19.953232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:19.955875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.955875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.955875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.955875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:19.957464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6555-1042-43f3-9565-38baedb2cb01 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:19.960818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 109/222] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:19.960818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:19.960818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:19.961655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:19.983998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:19.985250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:20.055509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 110/223] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:20.056360 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.070734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75424985-e77f-4324-8cc1-821aa8e3cdf4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.110232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.110921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.111204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.111479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.112241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:20.112549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.114012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.122750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 114/224] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:20.124008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.163113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3038cd4-2ce1-4a11-a258-0aab792e162f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.198534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.199125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.199466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.199748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.200456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.201952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.231403 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb74dbf-95df-4bab-8d99-58407b3d9e8c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.265373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.266253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.266525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.266798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.271619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 111/225] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:20 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:20.272673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.285530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:20.298369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:20.299328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:20.300129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:20.300726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 115/226] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:20.306439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.395506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b6e59-cf38-4b00-b993-49ac0afd17ca None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.434237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.435123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.435402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.435671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.436949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.438456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.440213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 112/227] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:20.442399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce35ef7-f78c-4a9a-a189-167bc747497e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.446527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.489398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.490002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.490287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.490563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.491321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:20.491628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.493935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.508751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 116/228] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:20.515132 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.573252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c247d4-a362-4500-92f4-8eedab5f1612 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.614568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.615874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.616158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.616749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.618840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.620887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.627430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 113/229] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:20.631030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.640580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b670d7-5f9b-46bc-8ad5-cf676a93ca1f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.691718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.693373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.693373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.693373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] PATH_INFO: `/v3/users/c55c27bc7a3f4bb4914c868100afa230` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.710039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c27bc7a3f4bb4914c868100afa230)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.717369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.719333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 117/230] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/users/c55c27bc7a3f4bb4914c868100afa230 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:20.727230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:20.775870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815168b8-b40b-4bf5-9551-986a489c3fbb None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.810602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.811545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.811831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.812173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/59483d81590d4d23bd2930708c9a6d97/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.814412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, user_id=59483d81590d4d23bd2930708c9a6d97, role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.815924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:20.848631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd8fd5-e6b9-41a2-b7d5-dcfd65065f10 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:20.885108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:20.886034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:20.886460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:20.886876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:20.925202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 114/231] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:20 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/59483d81590d4d23bd2930708c9a6d97/roles/fa903e57f2f4461fb91b94163f747824 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:20.959361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:20.961169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:21.067981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 118/232] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:21.073874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:21.230022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4e9c5-30d8-41b1-8842-461dd8a9f6d6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:21.269271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:21.270238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:21.270532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:21.270815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:21.272167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:21.274644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b366cf0-a7cc-487c-9063-06c7cd2dd2c3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:21.277701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 115/233] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:21 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:21.284047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:21.410714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e613b-06c0-4b9c-bec8-37728c79553a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:21.463117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:21.463786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:21.464074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:21.464349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:21.465228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=c55c27bc7a3f4bb4914c868100afa230) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:21.465547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:21.467034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151e62-d05c-400a-a79b-df71c294c922 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:21.473821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 119/234] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:21 2022] GET /identity/v3/role_assignments?user.id=c55c27bc7a3f4bb4914c868100afa230&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:22.689486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049545f-2d65-42ba-be05-d05bb9344986 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:22.689982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049545f-2d65-42ba-be05-d05bb9344986 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:22.689982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049545f-2d65-42ba-be05-d05bb9344986 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:22.691485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 116/235] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:22.698234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:22.698674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:22.698870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:22.736476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:22.737820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:22.835681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 120/236] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 11 12:38:22.874626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049545f-2d65-42ba-be05-d05bb9344986 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.018758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049545f-2d65-42ba-be05-d05bb9344986 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.057191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.057995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.058288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.058567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.074770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-5bd60dc0-9c11-431d-b099-ddcd00de1ba2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:23.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:23.083229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:23.083990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 117/237] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:23.090741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.090895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96028-ba8c-474b-a971-ea1e6167cb26 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.091112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96028-ba8c-474b-a971-ea1e6167cb26 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.091387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96028-ba8c-474b-a971-ea1e6167cb26 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.092966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 118/238] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38512b-298e-4e8f-92eb-d08854184637 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38512b-298e-4e8f-92eb-d08854184637 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38512b-298e-4e8f-92eb-d08854184637 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 119/239] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c499c2-a7d1-4b0b-ac8d-ab62160bb905 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.100979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c499c2-a7d1-4b0b-ac8d-ab62160bb905 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.102092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c499c2-a7d1-4b0b-ac8d-ab62160bb905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.118418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-92c499c2-a7d1-4b0b-ac8d-ab62160bb905 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:23.119701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-92c499c2-a7d1-4b0b-ac8d-ab62160bb905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:23.187536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 120/240] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:23.188651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.188939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.193293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.201401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969139c-f1ab-4db1-8262-9b78f95b26df None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.222156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:23.223385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:23.240256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.241117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.241400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.241672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.243407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:23.243708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.245111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.253692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 121/241] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:23.254560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.309640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 121/242] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:23.310775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.381310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df633c1-c4c9-457a-8cd6-6562ee6a9716 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.411788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c377c9e-2ecd-42ab-967e-c512c1ac301d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.416866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.417772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.418051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.418324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.429075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:23.437517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:23.438391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:23.439158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 122/243] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:23.439803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.451346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.452554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.453076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.453813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.455682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.457460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.459337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 122/244] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:23.460291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.541941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a34767-17ce-41ee-afdd-f506b2f09283 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.566696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258a0b9-d7c4-4dae-898e-8ea4a4c098e2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.576730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.578024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.578413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.578697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.580177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.582084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.584627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 123/245] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:23.589861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.608870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.609852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.610360 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.610833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.611835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:23.612336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.613972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.623902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 123/246] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:23.625011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.725747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569615-5aff-4253-82b1-3f28c3d6f9f8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.744244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe3848-03b4-49e2-8998-25f4c3fd3494 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:23.769165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.770201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.770689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.771193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.783762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:23.784512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.784835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.785174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:23.786480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.788668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.845525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:23.847003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbe52f-c111-4665-a3e1-c5fa9a98d38f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:23.900013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 124/247] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:23 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:23.909335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:23.997888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 124/248] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:23.999294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191e32-60bb-43d3-8afa-50c9382caeff None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:23.999584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191e32-60bb-43d3-8afa-50c9382caeff None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:23.999860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191e32-60bb-43d3-8afa-50c9382caeff None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.001411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 125/249] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:24.006348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191e32-60bb-43d3-8afa-50c9382caeff None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.066487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e6a4d-42a1-4971-8668-85501091a880 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.103151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.104103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.104284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.104520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] PATH_INFO: `/v3/users/2febb4a488df489aad448184ff37415f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.120479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] RBAC: Authorizing `identity:get_user(user_id=2febb4a488df489aad448184ff37415f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.122011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bb380-358d-4e55-a970-02f2d2c0a58e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.123763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 125/250] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:23 2022] GET /identity/v3/users/2febb4a488df489aad448184ff37415f => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.124975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.126094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.126378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.129883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191e32-60bb-43d3-8afa-50c9382caeff None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.144790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:24.145303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:24.168434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.170245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.170245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.170245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.171271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.173077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.180615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 126/251] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.180615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.235840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 126/252] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:24.238235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.306734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c67f42-476a-4001-94f7-d8eaed87c8a9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.345870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.346681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.347068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.347449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.382459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54add3e7-13a1-49eb-82bd-64cf130ac219 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.419798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.422216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16ba83-0f02-4a6c-812f-7a9cf61c460f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.433066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.434485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.435283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.435770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.437091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=59483d81590d4d23bd2930708c9a6d97) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:24.437778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.440141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.449366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 127/253] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/role_assignments?user.id=59483d81590d4d23bd2930708c9a6d97&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.450677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.550188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 127/254] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:24.552165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b58ca-6f10-471c-89f3-e08c8b379f8e None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.552792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b58ca-6f10-471c-89f3-e08c8b379f8e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.553298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b58ca-6f10-471c-89f3-e08c8b379f8e None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.555727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 128/255] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:24.558297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b58ca-6f10-471c-89f3-e08c8b379f8e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.590398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6ab71-2253-4192-9c79-6035bd593ef6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.675303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.676026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.676310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.676584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.692931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7758f815-8b1d-4d79-9289-66d2dc7161f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:24.701682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:24.702577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:24.703347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 128/256] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:24.704753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.704753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.704753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.722393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:24.723569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:24.748267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b58ca-6f10-471c-89f3-e08c8b379f8e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.792050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.792933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.793246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.793524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.794856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.796310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.798425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 129/257] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.799312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.801070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 129/258] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:24.803953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.907338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16e663-4785-4527-9a81-fe737e6cddd6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.909129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91308-9522-450a-8501-dfad910dff8a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:24.943888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.944987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.945603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.946075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.947027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:24.947399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=2febb4a488df489aad448184ff37415f) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:24.947829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:24.948128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.948238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:24.948514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:24.949369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:24.949758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:24.950509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.951308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:24.957065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 130/259] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/role_assignments?user.id=2febb4a488df489aad448184ff37415f&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=270e8661915e4bc3b532d58abc839627 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.958182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:24.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 130/260] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:24.967240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.066569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce262c-3aa0-4f09-86bb-fcdc0c76d6f4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.084502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725327-b9c7-4612-bceb-285db75e9e41 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.105125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.106278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.106771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.107219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.119195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:25.122637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.123747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.124182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.124584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] PATH_INFO: `/v3/users/59483d81590d4d23bd2930708c9a6d97` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.126047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] RBAC: Authorizing `identity:get_user(user_id=59483d81590d4d23bd2930708c9a6d97)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.127825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:25.129057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:25.129925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:25.130690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:25.131270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 131/261] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/users/59483d81590d4d23bd2930708c9a6d97 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:25.133553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 131/262] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:25.141076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.142479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.293281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb128b-f1ea-45bf-99d6-127ef0440ed5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.323475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe371-caad-4d9b-bd07-b7fc72e5b964 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.331127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.331800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.332087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.332364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.333156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:25.333949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.336573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.355167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 132/263] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:25.360766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.387523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.389340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.389621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.389892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.499213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.500689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.615433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 132/264] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:25.621227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.627368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a133-5c8f-4302-aaa6-57b805b43cea None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.701907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.702789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.703068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.703340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] PATH_INFO: `/v3/users/c55c27bc7a3f4bb4914c868100afa230` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.705937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c27bc7a3f4bb4914c868100afa230)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.707386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.709075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 133/265] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/users/c55c27bc7a3f4bb4914c868100afa230 => generated 297 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:25.717962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.828350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9610e-f145-4926-af8e-3893f573880e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.860329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d35c8-3383-4076-a21a-2d4a147a8868 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:25.899009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.899788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.900074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.900348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.901601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.903108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.904813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 134/266] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:25.910327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:25.912474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:25.913382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:25.913664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:25.914841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:25.921827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:25.923319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:25.925444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 133/267] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:25.931371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:26.022027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0683aa1-8739-42a4-aef6-82c37ed16938 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:26.060422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:26.061339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.061631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.061884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/c55c27bc7a3f4bb4914c868100afa230/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.064118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, user_id=c55c27bc7a3f4bb4914c868100afa230, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:26.065758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045f14-776c-42e2-9716-b8c6cad14926 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:26.111500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3bc05-5b4f-4972-87dd-08496526abb7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:26.148009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:26.148834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.149926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.149926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.150481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=59483d81590d4d23bd2930708c9a6d97) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:26.150794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:26.152286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b876427-2a71-47fb-9b88-7688c510bf80 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:26.158867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 134/268] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:25 2022] GET /identity/v3/role_assignments?user.id=59483d81590d4d23bd2930708c9a6d97&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=fa903e57f2f4461fb91b94163f747824 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:26.174138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 135/269] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:25 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/c55c27bc7a3f4bb4914c868100afa230/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:38:26.820807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2247-d0ff-4d39-8111-4799e07672bc None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.821565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2247-d0ff-4d39-8111-4799e07672bc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.822051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2247-d0ff-4d39-8111-4799e07672bc None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.823928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 135/270] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:26.829342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921f1-9cc7-4c12-8ab6-4df9fb72745f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.829876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921f1-9cc7-4c12-8ab6-4df9fb72745f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.830353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09921f1-9cc7-4c12-8ab6-4df9fb72745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.847823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e09921f1-9cc7-4c12-8ab6-4df9fb72745f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:26.849372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e09921f1-9cc7-4c12-8ab6-4df9fb72745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:26.921925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 136/271] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:26.946976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa2247-d0ff-4d39-8111-4799e07672bc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:26.947884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08ca5-dbb3-48a9-8f93-e7dcdbf0baf8 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.948179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08ca5-dbb3-48a9-8f93-e7dcdbf0baf8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.948456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f08ca5-dbb3-48a9-8f93-e7dcdbf0baf8 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.949878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 137/272] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:26.955007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:26.955298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:26.955575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:26.972550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:26.973783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:27.053361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 138/273] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:27.066291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa2247-d0ff-4d39-8111-4799e07672bc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.077588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.113014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.114755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.115266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.115754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.131483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:27.139765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:27.140839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:27.141670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 136/274] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:27.146827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.195984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926b492-c0e1-4fdd-a56f-deeb81712715 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.231015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.231582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.231861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.232128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.233463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:27.234953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:27.236999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 139/275] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:27.242232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.271099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9096-f6c5-4a56-9e34-384e2a5db1f7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.306701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.307791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.308303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.308884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.309840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:27.310415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:27.312102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:27.321318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 137/276] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:27.326300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.350247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf26092-96f1-48fd-b5ee-5b404d1b74c5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.388280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.389565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.390377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.390872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.391774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:27.394127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:27.446929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b634357-29a8-4d56-b874-8d2d95b63462 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.483354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.484562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.484840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.485348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] PATH_INFO: `/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.489719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 140/277] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:27 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:38:27.501426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] RBAC: Authorizing `identity:get_user(user_id=99f7a6c7866a45aa83a3a5ea175f3c00)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:27.502953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dc6bf-cfc8-4bbd-ae57-0b16db48ef3b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:27.505142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 138/278] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:27.511147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.615148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca272dc-70a0-4eda-a86c-7ff1c3969a70 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.615433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca272dc-70a0-4eda-a86c-7ff1c3969a70 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.615748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca272dc-70a0-4eda-a86c-7ff1c3969a70 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.619015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 139/279] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:27.623400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.624082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.624553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.642938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:27.643753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfbe2-6d68-47c9-a84e-1da413e4b062 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.644722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:27.689493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.692867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.693180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.693457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.694308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, user.id=99f7a6c7866a45aa83a3a5ea175f3c00, scope.system=all) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:27.694622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:27.696873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:27.711956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 141/280] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/role_assignments?user.id=99f7a6c7866a45aa83a3a5ea175f3c00&scope.system=all&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:27.738732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 140/281] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:27.763518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:27.879473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce52ca-c0af-4f3d-b65f-dee6ee6e2009 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:27.919940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:27.920736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:27.921013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:27.921311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:27.933468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:27.941368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:27.942214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:27.942998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 142/282] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:27.949700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:28.083790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835dcff6-4716-416a-b8c6-13aff476eec5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:28.136118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:28.136797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.137097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.137374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.138177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:28.138484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:28.139860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:28.153459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 141/283] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:28.159359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:28.288587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447504c5-1cd6-45f6-8112-86172f4f767f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:28.332803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:28.333876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.334136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.334420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] PATH_INFO: `/v3/users/2febb4a488df489aad448184ff37415f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.341322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] RBAC: Authorizing `identity:get_user(user_id=2febb4a488df489aad448184ff37415f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:28.342870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:28.344573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 143/284] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:28 2022] GET /identity/v3/users/2febb4a488df489aad448184ff37415f => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:28.350146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:28.489382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b42901-85ea-443f-a04f-5e326167d372 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:28.539880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:28.540618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.540903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.541207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.542415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:28.544230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ede2a-e399-4d9a-825e-4143cd31fad6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:28.546067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 142/285] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:28 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:28.551986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:28.660232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904fa3-956c-45a8-9904-29bbc7e6963e None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.660545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904fa3-956c-45a8-9904-29bbc7e6963e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.660878 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904fa3-956c-45a8-9904-29bbc7e6963e None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.662469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 143/286] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:28.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.668913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.669221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.687596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72693c11-0e1d-4825-a58f-9ae4b126de13 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:28.688905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:28.693064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:28.763825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:28.764847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.765220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.765553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/2febb4a488df489aad448184ff37415f/roles/270e8661915e4bc3b532d58abc839627` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.768828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, user_id=2febb4a488df489aad448184ff37415f, role_id=270e8661915e4bc3b532d58abc839627)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:28.770501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:28.795468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 144/287] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:28.821563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:28.844644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 144/288] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:38:28 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/users/2febb4a488df489aad448184ff37415f/roles/270e8661915e4bc3b532d58abc839627 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:28.927833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408a59-8178-4a80-ab2e-dfa69ccbda98 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:28.972435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:28.973284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:28.973569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:28.973843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:28.990529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:28.998371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:28.999240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:29.000014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 145/289] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:29.010614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:29.144075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec1b29-ea33-4ddd-9a9e-3cc75f1afcd4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:29.186333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:29.186939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:29.187227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:29.187503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:29.188260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:29.188630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:29.190056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:29.200393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 145/290] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:29.206176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:29.349830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bca41-0e95-4c9f-bdff-1d7a96bb39ea None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:29.401759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:29.402789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:29.403081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:29.403420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] PATH_INFO: `/v3/users/c55c27bc7a3f4bb4914c868100afa230` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:29.404767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c27bc7a3f4bb4914c868100afa230)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:29.406476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:29.408500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 146/291] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:29 2022] GET /identity/v3/users/c55c27bc7a3f4bb4914c868100afa230 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:29.414854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:29.561120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82622c62-6154-4614-8a2d-51cc3078e7db None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:29.606617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:29.607623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:29.608132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:29.608604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:29.699566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:29.701095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:29.848495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 146/292] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:29.855285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:29.984163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efeb2f-e832-482d-86fe-38df175cedc4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:30.026814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:30.027731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.028011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.028275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.033767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:30.035228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a457956-821d-4230-8169-b7e31926c259 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:30.037315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 147/293] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:29 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:30.044152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:30.180746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64490039-8f0c-4b93-bfc9-7968d08fae40 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:30.228295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:30.228960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.229272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.229551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.230388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=c55c27bc7a3f4bb4914c868100afa230) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:30.230697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:30.232126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79636e-474b-4bb6-93b6-a9af62b6acce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:30.242918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 147/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:30 2022] GET /identity/v3/role_assignments?user.id=c55c27bc7a3f4bb4914c868100afa230&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:30.338100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813de-5d0c-4e51-b7f3-a34452b5d759 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.338635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813de-5d0c-4e51-b7f3-a34452b5d759 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.339054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700813de-5d0c-4e51-b7f3-a34452b5d759 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.341126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 148/295] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:30.346704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.347270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.347761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.374189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:30.375643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:30.466409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 148/296] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:30.507420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700813de-5d0c-4e51-b7f3-a34452b5d759 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:30.625169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700813de-5d0c-4e51-b7f3-a34452b5d759 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:30.660911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:30.661956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.662374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.662819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.664843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:30.666471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83c8ad-eedd-43bd-92f3-28ad710446f8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:30.670057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 149/297] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:30.678598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:30.768880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8788fe-6c5d-44e5-b814-be463e9f3b21 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.769081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8788fe-6c5d-44e5-b814-be463e9f3b21 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.769366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8788fe-6c5d-44e5-b814-be463e9f3b21 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.770896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 150/298] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:30.776555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b553cd-e9a0-4fba-a76a-af237417dac6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.777190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b553cd-e9a0-4fba-a76a-af237417dac6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.777689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b553cd-e9a0-4fba-a76a-af237417dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.802312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-58b553cd-e9a0-4fba-a76a-af237417dac6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:30.803326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-58b553cd-e9a0-4fba-a76a-af237417dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:30.809313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d028-6fc2-4e8c-a09b-6f0fa8ed34db None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:30.854190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:30.854872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.855160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.855441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] PATH_INFO: `/v3/groups` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.856137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:30.857640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b6e4a-2fa5-4939-8e37-759591084c79 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:30.902906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 151/299] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:30.923601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ff9c-a3ee-46b1-a7dd-4d8c00a41fcc None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.923601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ff9c-a3ee-46b1-a7dd-4d8c00a41fcc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.923601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ff9c-a3ee-46b1-a7dd-4d8c00a41fcc None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.923601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 152/300] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:30.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 149/301] 10.222.0.49 () {60 vars in 1134 bytes} [Wed May 11 12:38:30 2022] POST /identity/v3/groups => generated 229 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:38:30.927288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ff9c-a3ee-46b1-a7dd-4d8c00a41fcc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:30.930579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:30.930851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:30.935993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:30.955214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:30.957175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:31.045940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 150/302] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:31.061029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ff9c-a3ee-46b1-a7dd-4d8c00a41fcc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.067841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.102293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.103118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.103404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.103681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.115589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:31.124307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:31.125224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:31.125993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 153/303] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:31.132189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.180944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb35cc2-9b90-4244-afd6-6983c6e61c89 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.216101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.216906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.217219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.217493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.228077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:31.236259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:31.238640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:31.240599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 151/304] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:31.249074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.263499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c98f7c-4d15-4e0c-a6ad-143d9b0e624f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.307693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.308375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.308706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.313100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.313100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:31.313100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.313100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.326164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 154/305] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:31.333279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.372823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87275d4-2f81-44d8-8402-f5219d78e9d6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.412943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.414101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.414634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.415077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.416003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:31.416464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.418079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.427752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 152/306] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:31.434687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.452208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde630b5-28d6-4bc9-af59-a9f020518c64 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.487177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.488054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.488334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.488609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] PATH_INFO: `/v3/users/cd26fc40724c48f3b2510b2ec727e518` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.504272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] RBAC: Authorizing `identity:get_user(user_id=cd26fc40724c48f3b2510b2ec727e518)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.506485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.513207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 155/307] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/users/cd26fc40724c48f3b2510b2ec727e518 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:31.516030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.553770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d29d1-61a1-496d-8e50-81d485ed860b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.595914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.596794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.597104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.597380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] PATH_INFO: `/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.598891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=99f7a6c7866a45aa83a3a5ea175f3c00)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.600244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4a653-e060-4b27-a482-e92d90074ab9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.602554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 153/308] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:31.603570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3e55-3495-4289-87a4-cd54cc034671 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.603852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3e55-3495-4289-87a4-cd54cc034671 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.604126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3e55-3495-4289-87a4-cd54cc034671 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.605505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 154/309] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:31.610096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3e55-3495-4289-87a4-cd54cc034671 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.627847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1310931-a143-4967-a524-c7be954d3711 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.662396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.664006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.664367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.664733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.665640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, user.id=cd26fc40724c48f3b2510b2ec727e518, scope.system=all) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:31.665989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.667453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acba950-9104-45e6-964a-323cd3e8fb32 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.685442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 156/310] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/role_assignments?user.id=cd26fc40724c48f3b2510b2ec727e518&scope.system=all&role.id=270e8661915e4bc3b532d58abc839627 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:31.685442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.685442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.685442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.705448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:31.706663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:31.742999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3e55-3495-4289-87a4-cd54cc034671 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.791567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.793150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.793641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.794404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 157/311] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:31.794773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] PATH_INFO: `/v3/system/users/99f7a6c7866a45aa83a3a5ea175f3c00/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.796793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=99f7a6c7866a45aa83a3a5ea175f3c00, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:31.798512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:31.819243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:31.879357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 155/312] 10.222.0.49 () {58 vars in 1334 bytes} [Wed May 11 12:38:31 2022] PUT /identity/v3/system/users/99f7a6c7866a45aa83a3a5ea175f3c00/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:31.934877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4be6d3-a246-41b1-9659-e07b239130cc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:31.974481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:31.975715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:31.976243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:31.976710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:31.989591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:31.998876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:31.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:32.000642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:32.003460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 158/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:32.010661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:32.126230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3c84-1215-4c28-b972-7313c6a74330 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:32.162346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:32.162923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:32.163206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:32.163521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:32.164301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:32.164652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:32.166133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:32.174697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 156/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:32.180954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:32.286847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d338b-a9d4-445c-802e-1e4ee7a3393f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:32.321757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:32.322628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:32.322904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:32.323186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] PATH_INFO: `/v3/users/2febb4a488df489aad448184ff37415f` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:32.324352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] RBAC: Authorizing `identity:get_user(user_id=2febb4a488df489aad448184ff37415f)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:32.325842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:32.327484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 159/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:32 2022] GET /identity/v3/users/2febb4a488df489aad448184ff37415f => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:32.332918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:32.439096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717f04-69ec-4cfa-a71c-ec0edd462dfe None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:32.473308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:32.474346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:32.474833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:32.475330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:32.546120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:32.547951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:32.686913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 157/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:32.693675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:32.803789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc060f4-57fb-42d5-a0c7-055ed5d25089 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:32.837989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:32.838855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:32.839141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:32.839414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:32.840586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:32.842041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd1987-1eef-4dbd-a4d8-7aba5fe22c5a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:32.844063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 160/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:32 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:32.849692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:32.952761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4133a10-1349-4740-9b6e-8468f9266c97 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:32.987795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:32.988818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:32.989346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:32.989825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:32.990855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9, user.id=2febb4a488df489aad448184ff37415f) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:32.991466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:32.993994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1569b9d-d7bf-4e80-8653-c354a72e959d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:33.000881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 158/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:38:32 2022] GET /identity/v3/role_assignments?user.id=2febb4a488df489aad448184ff37415f&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=270e8661915e4bc3b532d58abc839627 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:33.279137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971b3c-cf6f-4e4f-bd34-6b5e1c4abc40 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:33.279613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971b3c-cf6f-4e4f-bd34-6b5e1c4abc40 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:33.279613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c971b3c-cf6f-4e4f-bd34-6b5e1c4abc40 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:33.281176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 161/319] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:33.286351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:33.286775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:33.286947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:33.303719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:33.305757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:33.373084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 159/320] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:33.393494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c971b3c-cf6f-4e4f-bd34-6b5e1c4abc40 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:33.491042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c971b3c-cf6f-4e4f-bd34-6b5e1c4abc40 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:33.524917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:33.525816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:33.526104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:33.526381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:33.527613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:33.529083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673e69-ccf1-4b17-8509-9d3237e33fcd None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:33.539299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 162/321] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:33.539472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:33.636244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82cede-3a02-4446-8a75-87d324aacf60 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:33.669482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:33.670494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:33.670935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:33.671368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] PATH_INFO: `/v3/groups` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:33.672206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:33.673847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4738e-6055-41eb-a3a9-ce6c58971a3f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:33.773249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 160/322] 10.222.0.49 () {60 vars in 1134 bytes} [Wed May 11 12:38:33 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:34.029282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c21ba-5d30-4437-a296-23ad6d78ca33 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.029787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c21ba-5d30-4437-a296-23ad6d78ca33 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.030200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c21ba-5d30-4437-a296-23ad6d78ca33 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.031775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 163/323] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:34.037812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b272-12e8-4ed3-ae11-06442ef1059d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.038094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b272-12e8-4ed3-ae11-06442ef1059d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.038628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b272-12e8-4ed3-ae11-06442ef1059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.058101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b8a5b272-12e8-4ed3-ae11-06442ef1059d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:34.059309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b8a5b272-12e8-4ed3-ae11-06442ef1059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:34.130189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 161/324] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:34.153404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c21ba-5d30-4437-a296-23ad6d78ca33 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.215084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b232c-3acd-4bc9-8ea6-43293044a891 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.215416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b232c-3acd-4bc9-8ea6-43293044a891 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.215707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b232c-3acd-4bc9-8ea6-43293044a891 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.217163 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 162/325] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:34.222517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.222807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.223083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.245312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:34.246831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:34.279473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c21ba-5d30-4437-a296-23ad6d78ca33 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.315879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.317309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.317887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.318634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.323848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 163/326] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:34.331554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:34.340322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:34.341268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:34.342064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 164/327] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:34.349714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.361325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.470950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9ad58-91ad-4125-9e6a-1497aa64cf86 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.493363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052db0e7-7808-4d63-a640-70db2cf19f5b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.510928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.511932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.512471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.512926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.513909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:34.514400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:34.515991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:34.525999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 164/328] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:34.531650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.531650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.531650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.531936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.532577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.543537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:34.551311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:34.552260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:34.553017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 165/329] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:34.558888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.643804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349eeb5-6f3f-4faf-8488-ea9c098ad66f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.663970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca3d78-020b-4b13-b3dc-6ac049c5511b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.679901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.681153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.681598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.682017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] PATH_INFO: `/v3/users/cd26fc40724c48f3b2510b2ec727e518` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.683408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] RBAC: Authorizing `identity:get_user(user_id=cd26fc40724c48f3b2510b2ec727e518)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:34.684992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:34.687645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 165/330] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/users/cd26fc40724c48f3b2510b2ec727e518 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:34.694214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.700001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.700683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.700966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.701274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.702027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:34.702331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:34.703725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:34.712860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 166/331] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:34.718328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.800197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606a910-4f79-414b-af23-e329e4cf8304 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.823121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea78da9-b6e2-4ba7-a1b5-3de144e5a651 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:34.836690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.837915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.838361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.838839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] PATH_INFO: `/v3/system/users/cd26fc40724c48f3b2510b2ec727e518/roles/270e8661915e4bc3b532d58abc839627` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.840540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd26fc40724c48f3b2510b2ec727e518, role_id=270e8661915e4bc3b532d58abc839627)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:34.842092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084fe9-6fb0-4521-b044-9eabb89acab7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:34.861956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:34.862839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:34.863120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:34.863392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] PATH_INFO: `/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:34.865853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] RBAC: Authorizing `identity:get_user(user_id=99f7a6c7866a45aa83a3a5ea175f3c00)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:34.868257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:34.870288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 167/332] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/users/99f7a6c7866a45aa83a3a5ea175f3c00 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:34.875969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:34.916935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 166/333] 10.222.0.49 () {58 vars in 1334 bytes} [Wed May 11 12:38:34 2022] PUT /identity/v3/system/users/cd26fc40724c48f3b2510b2ec727e518/roles/270e8661915e4bc3b532d58abc839627 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:34.999294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531c48b-e866-4b68-8c6b-318004ad8652 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:35.036689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:35.037456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:35.037747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:35.038079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:35.039237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] RBAC: Adding query filter params (role.id=b0bbf919a58b47ed9dae65f2ea7472f0, user.id=99f7a6c7866a45aa83a3a5ea175f3c00, scope.system=all) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:35.039558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:35.041161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e43c5e-18b2-4609-8de8-da0166722934 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:35.056588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 168/334] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 11 12:38:34 2022] GET /identity/v3/role_assignments?user.id=99f7a6c7866a45aa83a3a5ea175f3c00&scope.system=all&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:36.562437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876189-f783-4472-bd0a-84c10c2ceecd None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:36.563460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876189-f783-4472-bd0a-84c10c2ceecd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:36.563945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8876189-f783-4472-bd0a-84c10c2ceecd None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:36.565942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:36.571875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:36.572716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:36.573252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:36.593497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:36.594969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:36.674214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:36.699694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8876189-f783-4472-bd0a-84c10c2ceecd None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:36.805811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8876189-f783-4472-bd0a-84c10c2ceecd None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:36.840337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:36.841158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:36.841439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:36.841709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:36.852362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:36.859974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:36.860845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:36.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 168/337] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:36.867951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:36.969069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448aff-155c-4d32-8b86-86e5f9b19046 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:37.003915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:37.004636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.004886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.005188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.005938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:37.006240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:37.007702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:37.017071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 170/338] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:37.036782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:37.173511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33500155-5efe-49ee-8ce4-b3a9da03990d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:37.218228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:37.218886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.219172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.219452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.309727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:37.311222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bd857-9134-4b9b-b7e1-f3f60a749318 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:37.427159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 169/339] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:37.432589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:37.468546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36857a-3ab4-4d0c-b153-104731451aa2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.468866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36857a-3ab4-4d0c-b153-104731451aa2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.469149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36857a-3ab4-4d0c-b153-104731451aa2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.470553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 170/340] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:37.476976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.477306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.477587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.504675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:37.505891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:37.616016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53349994-a34f-41d2-b14a-8c1e8a008a5b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:37.637545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 171/341] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:37.668016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:37.668935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.669242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.669519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.670760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:37.672204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:37.676422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:37.690486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 171/342] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:37 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:37.711166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:37.858039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0fe8e-0cdd-4484-a601-e45ec388f753 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:37.899053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abc385-58c2-433a-8306-3cd4daa0b499 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:37.941728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:37.942532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.942810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.943081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.951621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:37.953248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:37.954492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:37.955200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 172/343] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:37 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:37.955308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:37.955588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:37.955857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:37.963004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:37.983698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:37.992749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:37.993763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:37.994550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:38.006700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 172/344] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:38.023957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:38.105301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c44949-7803-4f26-89c3-5015f37b929b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.144591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:38.145280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.145546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.145826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.147242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=22c5658eb7fb4c758ff6cac952410994) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:38.148156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:38.149863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be722d-5631-4a9d-bd2c-fcb25d7893c0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:38.156373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 173/345] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:37 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:38.198788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d0e0-d16a-4667-95d2-551057509272 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.199096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d0e0-d16a-4667-95d2-551057509272 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.199262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3d0e0-d16a-4667-95d2-551057509272 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.200632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 174/346] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:38.209208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ad58-f5ea-43ec-bc01-34d5a1188405 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.209208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ad58-f5ea-43ec-bc01-34d5a1188405 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.209208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073ad58-f5ea-43ec-bc01-34d5a1188405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.230001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b610721-c01c-46a3-80dd-da0d72124842 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.247483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8073ad58-f5ea-43ec-bc01-34d5a1188405 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:38.251786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8073ad58-f5ea-43ec-bc01-34d5a1188405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:38.309603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253995e-a643-4339-887d-061a472e9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:38.310905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253995e-a643-4339-887d-061a472e9193 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.311427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253995e-a643-4339-887d-061a472e9193 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.311931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253995e-a643-4339-887d-061a472e9193 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.312921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253995e-a643-4339-887d-061a472e9193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:38.314247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253995e-a643-4339-887d-061a472e9193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:38.315893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253995e-a643-4339-887d-061a472e9193 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:38.333696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 173/347] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:38.337063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668d78-e216-494d-b28a-fbdf9018640a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.342100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668d78-e216-494d-b28a-fbdf9018640a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.342671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a668d78-e216-494d-b28a-fbdf9018640a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.344327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 174/348] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:38.346116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a668d78-e216-494d-b28a-fbdf9018640a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:38.405256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 175/349] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:38.406856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.407170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.407445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.428604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:38.437100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:38.503278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a668d78-e216-494d-b28a-fbdf9018640a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.547696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:38.548722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.549251 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.549767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.570616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 176/350] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:38.571443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:38.635790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:38.637844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:38.771760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee5cff-58b8-4d81-8d77-1a798451832e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.816073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 175/351] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:38.816919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:38.827071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:38.827880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.828160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.828429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.840703 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d867a962-0205-440f-8d52-e42783fde2c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:38.850508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:38.852623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:38.853446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 177/352] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:38.854086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa3450-73fc-44e7-8c5f-012130ac6bc2 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.854647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa3450-73fc-44e7-8c5f-012130ac6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.854647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa3450-73fc-44e7-8c5f-012130ac6bc2 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.862242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 178/353] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:38.862242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa3450-73fc-44e7-8c5f-012130ac6bc2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:38.937055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff981b-daaf-417e-ae5a-a51af9272397 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.971011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa3450-73fc-44e7-8c5f-012130ac6bc2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:38.977712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:38.978816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:38.979295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:38.979776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:38.992344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:39.000928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:39.001837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:39.002613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:39.005331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 176/354] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:39.006175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.006732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.007626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.008322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.008322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.009581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.011378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd208411-83d3-4372-995e-ace3201a5cb8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.014026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 179/355] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:38 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.015231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.015513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.015786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.032759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:39.033910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:39.101825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 180/356] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:39.102778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.120647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17c89b-4e09-4b26-a7af-ca9eade67ff9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.159241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.160335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.160846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.161373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.162355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:39.162888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.165217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.175316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 177/357] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.176476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.214414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094b1dd-7d6d-41f0-bd58-4d0fbe5dfe89 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.248879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.249604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.249883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.250151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.250953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:39.251192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.252668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.262534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 181/358] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.263367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.292228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df7c9-e0ac-4c9b-91f7-29670b527bdb None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.331934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.332803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.333106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.333390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.334624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.336709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.339354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 178/359] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.340134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.384721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2060419-154d-4f33-83a4-c3f320d900fc None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.423032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.423873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.424377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.424655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.435987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:39.444085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:39.445003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:39.445818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 182/360] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:39.446475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.465453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b08a76-8af1-4ec4-af8d-f51accf4a14e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.513225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.515118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.515407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.515688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] PATH_INFO: `/v3/users/cd26fc40724c48f3b2510b2ec727e518` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.516924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] RBAC: Authorizing `identity:get_user(user_id=cd26fc40724c48f3b2510b2ec727e518)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.518445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.520119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 179/361] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/users/cd26fc40724c48f3b2510b2ec727e518 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.520889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.568587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610680-07ba-4863-a4f4-a3d3a01a6aa0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.618084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.619127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.619417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.619699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.649258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbbea2-10ee-4834-ad57-a216de617bdc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.698065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.700059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.700059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.700059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.700592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=22c5658eb7fb4c758ff6cac952410994) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:39.700917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.703074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebbb78-97e9-4308-a817-5f829473053b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.709201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.711153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=fa903e57f2f4461fb91b94163f747824 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.711273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.714421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd663-ac6b-4bd9-b2c8-438075af04d2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.714714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd663-ac6b-4bd9-b2c8-438075af04d2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.714994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fd663-ac6b-4bd9-b2c8-438075af04d2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.716598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 181/363] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:39.717278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fd663-ac6b-4bd9-b2c8-438075af04d2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.831237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 183/364] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:39.832370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:39.834185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fd663-ac6b-4bd9-b2c8-438075af04d2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:39.885292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:39.885995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.886285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.886564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.887344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:39.887661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:39.891075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54a29c-8c19-455e-b0b0-0ed45cbacbce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:39.905404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 182/365] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:39.906811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:39.907103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:39.907387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:39.926130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:39.927357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:39.967290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a90623-e419-4b5d-ba49-f697108dbbf6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.010233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.010963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.011296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.011577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.012432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] RBAC: Adding query filter params (role.id=270e8661915e4bc3b532d58abc839627, user.id=cd26fc40724c48f3b2510b2ec727e518, scope.system=all) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:40.012739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.014242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.026802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 183/366] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:40.027486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.034682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 184/367] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 11 12:38:39 2022] GET /identity/v3/role_assignments?user.id=cd26fc40724c48f3b2510b2ec727e518&scope.system=all&role.id=270e8661915e4bc3b532d58abc839627 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.036679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.159866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422d33-6c13-43f7-940b-3aef90fc539a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.175792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc6be-382d-4634-8999-28364d83ad39 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.201390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.202535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.202824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.203094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.204305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.205771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.208842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 184/368] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.209791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.224549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.225265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.225582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.226400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.323962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.325529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.333502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa4fa4-a315-4655-8a48-26c883057abc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.380771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.382027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.383953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.384464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.401523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:40.410768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:40.411620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:40.412363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:40.415657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 185/369] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:40.416673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.485746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 185/370] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:40.486602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.533543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112a17e-339e-4d9c-b477-0d10f04ad75d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.572446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.572960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.573281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.573560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.574768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.576247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.579204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 186/371] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.579991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.613300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d447e-5e49-4935-bff1-5ce205669831 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.656621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.657848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.658337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.659139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.660409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:40.661159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.663946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.675009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 186/372] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.676174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.717989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9363-7a99-4f26-ae73-ef1e1ba36891 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.762518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.763812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.764227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.765562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.767493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.769098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.771473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 187/373] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.773973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.839500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66602623-f397-4fb9-be63-f66184a456ea None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.881641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.883470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.883906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.884339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:40.885615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:40.885731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cda81-dc7b-4b17-9bf7-008fceaa5bce None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:40.886187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:40.887982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:40.895608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 187/374] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:40.896688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:40.956508 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:40.958509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:40.959110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:40.959573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.048393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.050987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.093437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5e5c2-5bfc-49f3-a63d-7df17a2364d6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.141660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.142548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.142820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.143090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.144302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.145827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.148533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 188/375] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:41.154203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.172880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 188/376] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:41.181910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.287125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f85fad-49a7-46d2-892d-971a9e09455e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.316348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c38e8-5336-4799-a0f2-8a2718ebcb12 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.323817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.324027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.324310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.324401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.325269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:41.325578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.327384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63e83-9d7a-4586-886d-6f66eecc794d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.333424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 189/377] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=fa903e57f2f4461fb91b94163f747824 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:41.334703 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e6a2-f2f2-4170-961c-366caaadce6f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.335633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e6a2-f2f2-4170-961c-366caaadce6f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.335912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4e6a2-f2f2-4170-961c-366caaadce6f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.338742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 190/378] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:41.344574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.344858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.345165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.366235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:41.367486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:41.384398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.385677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.385966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.386275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] PATH_INFO: `/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.392288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] RBAC: Authorizing `identity:get_project(project_id=9ea94fb17e4549a0aa68e4ab8008eb33)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.393856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.395698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 189/379] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:41.413751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.509595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 191/380] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:41.548612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.584341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63963da0-6d77-4fde-b164-016a37e1e162 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.623262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.624174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.624453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.624722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] PATH_INFO: `/v3/groups/2586c5113e84445e878f22c79629f416` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.632102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] RBAC: Authorizing `identity:get_group(group_id=2586c5113e84445e878f22c79629f416)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.633822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.641387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 190/381] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/groups/2586c5113e84445e878f22c79629f416 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:41.642245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.680311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9107e-c3a9-43ef-9ae2-b0c587d7b6da None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.738739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.739563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.739844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.748381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976a7da-8604-49b8-9894-d9b971831eff None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.762983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:41.770803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:41.771692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:41.772493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:41.777429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 192/382] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:41.778338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:41.785124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.785846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.786126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.786395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.787234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] RBAC: Adding query filter params (group.id=2586c5113e84445e878f22c79629f416, role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=9ea94fb17e4549a0aa68e4ab8008eb33) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:41.787541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.789349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:41.795754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 191/383] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/role_assignments?group.id=2586c5113e84445e878f22c79629f416&scope.project.id=9ea94fb17e4549a0aa68e4ab8008eb33&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:41.916658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00930d-eba5-4b88-b81f-53b72601bf00 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:41.985953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:41.986706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:41.987219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:41.987602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:41.988392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:41.988750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:41.990592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:42.016691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 193/384] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:42.025630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:42.195995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da22b-5cf4-41fc-897d-b90e96c72618 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:42.274316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:42.275231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:42.275512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:42.281256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:42.282022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:42.283504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:42.287440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 192/385] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:42 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:42.305123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:42.438596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1f958-1145-4305-8bf8-d4bdf5412543 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:42.474345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:42.475120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:42.476967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:42.476967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:42.477862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:42.479332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf661b-a56c-4582-b906-aaf1b471bdf7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:42.481095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 194/386] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:42 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:42.488826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:42.724673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddeed43-c7af-4b3e-a571-a46ae80a4ea2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:42.763087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fe51-e1dd-4bdc-b8c6-ac916617357b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:42.763506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fe51-e1dd-4bdc-b8c6-ac916617357b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:42.763664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0fe51-e1dd-4bdc-b8c6-ac916617357b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:42.766870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 195/387] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:42.776109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:42.776109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:42.776109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:42.841066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:42.841066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:42.881822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:42.882805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:42.883085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:42.883341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/groups/af9a2c210ef64fe3b392fecf76497266/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:42.893940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, group_id=af9a2c210ef64fe3b392fecf76497266, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:42.895408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:42.995912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 193/388] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 11 12:38:42 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/groups/af9a2c210ef64fe3b392fecf76497266/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:43.020120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 196/389] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:43.054877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:43.204256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c77d3-1ff9-4290-83f5-245d9340c759 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:43.248690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:43.249753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:43.250183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:43.250616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:43.271816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:43.280723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:43.281774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:43.282744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:43.284802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 194/390] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:43.291448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:43.405364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6bbbb-00a6-4f06-a31f-c25d4143fefb None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:43.446410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:43.447103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:43.447384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:43.447655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:43.448418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:43.448723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:43.450219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:43.459025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 197/391] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:43.465390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:43.618294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5f40f-e9a0-4dcd-a9ca-3716c0ff3b5c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:43.661856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:43.662843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:43.663744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:43.664083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:43.669945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:43.671430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:43.673218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 195/392] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:43 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:43.679210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:43.807464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf4934-df9f-4f02-a3fe-93d8d17bbeac None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:43.848444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:43.849801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:43.850288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:43.851325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:43.852881 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:43.854741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765088ff-6e68-464f-8cc1-068c0010a454 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:43.856701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 198/393] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:43 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:43.862990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:43.999825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc9ba-6c03-41ea-986a-fccd21ecc574 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.000450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc9ba-6c03-41ea-986a-fccd21ecc574 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.000940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc9ba-6c03-41ea-986a-fccd21ecc574 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.002534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 199/394] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:44.011546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.011546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.011763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59ea10-59dd-421a-9f95-0649da2b6a83 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:44.012229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.032552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:44.034568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:44.079695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:44.080630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.080916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.081219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994/groups/af9a2c210ef64fe3b392fecf76497266/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.086411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] RBAC: Authorizing `identity:create_grant(project_id=22c5658eb7fb4c758ff6cac952410994, group_id=af9a2c210ef64fe3b392fecf76497266, role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:44.087920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:44.146274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 200/395] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:44.156837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 196/396] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 11 12:38:43 2022] PUT /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994/groups/af9a2c210ef64fe3b392fecf76497266/roles/fa903e57f2f4461fb91b94163f747824 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:44.181320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:44.306577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45366b-9e14-4114-8503-59bd4253a9e5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:44.350035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:44.351142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.351619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.351901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.364532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:44.375869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:44.376888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:44.377695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:44.381145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 201/397] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:44.384469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:44.498725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171950dd-2796-4cf7-b82a-d80cd26f0501 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:44.536544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:44.537272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.537557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.538428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.539571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:44.539942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:44.541363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be967-956a-4171-81cd-62e1d56f87d5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:44.550370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 197/398] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:44.557453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:44.637977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd072e1-fb82-4cfa-a882-7407952186f7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.638303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd072e1-fb82-4cfa-a882-7407952186f7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.638527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd072e1-fb82-4cfa-a882-7407952186f7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.640122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 198/399] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:44.647780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.648361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.648913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.671031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407001fc-ace9-4909-82a8-32b9e56ae7b2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:44.690102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:44.691466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:44.717636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:44.718710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.718990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.719263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.722987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:44.724621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:44.729493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 202/400] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:44 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:44.734043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:44.831026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 199/401] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:44.875953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:44.883793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a7f85-2ac7-41a1-9cb8-d22510e3ea72 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:44.930281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:44.931225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:44.931503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:44.931825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:44.933066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:44.937234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:44.947737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 203/402] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:44 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:44.952123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.066670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e3c50-a97f-41a3-917c-8083df247136 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.108586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96107fd2-a467-4e67-94a7-05fa2f2c9cbf None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.127476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.128637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.129195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.129664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.141964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:45.145202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.146088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.146364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.146634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/groups/af9a2c210ef64fe3b392fecf76497266/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.149255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, group_id=af9a2c210ef64fe3b392fecf76497266, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.150680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cdfcb-8452-4eef-a47b-13678a293efb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-aa378261-abf4-4bd9-98d9-9f6f58ce05cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:45.152814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:45.153827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:45.154719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:45.156999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 200/403] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:45.158611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a621-d7d6-45b4-bd8c-42859bdab372 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.159108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a621-d7d6-45b4-bd8c-42859bdab372 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.159671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a621-d7d6-45b4-bd8c-42859bdab372 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.161501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 201/404] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:45.162585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219a621-d7d6-45b4-bd8c-42859bdab372 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.264263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219a621-d7d6-45b4-bd8c-42859bdab372 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.266207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 204/405] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 11 12:38:44 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/groups/af9a2c210ef64fe3b392fecf76497266/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:38:45.267540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.267829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.268105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.288453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:45.289745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:45.330756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.332024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.332316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.332594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.333482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:45.333794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.336615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.347723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 202/406] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:45.354817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.425272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 205/407] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:45.459345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.505796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ab4d-4591-47a2-959c-ff05fd5a783a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.542414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.543328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.543567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.543843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.545060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.546531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.548577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 203/408] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:45.554510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.593528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d917c-557b-4cfc-963a-40488d89e2cb None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.631628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.632999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.633320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.633645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.646611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:45.654950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:45.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:45.659381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 206/409] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:45.669130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.672289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137148c-1c7c-47b4-bb7a-5c48a9c3b4d9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.714057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.716964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.717285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.717566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.718805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.725081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.725081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 204/410] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:45.728884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:45.830757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f093-2b01-4650-982e-76025690a171 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.880311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac62a-2d87-40ac-b1a2-8f2c9b10d0d3 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:45.906694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.907385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.907672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.907949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.908708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:45.909014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.910432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.915726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:45.916676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:45.916959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:45.917266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/groups/af9a2c210ef64fe3b392fecf76497266/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:45.919949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9, group_id=af9a2c210ef64fe3b392fecf76497266, role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:45.921496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:45.932879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 207/411] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:45.939033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:46.007985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 205/412] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 11 12:38:45 2022] PUT /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9/groups/af9a2c210ef64fe3b392fecf76497266/roles/fa903e57f2f4461fb91b94163f747824 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:46.054274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc5e30-90fa-43fd-afb3-d65ddd32e18e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:46.090394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:46.091352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.091633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.091907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] PATH_INFO: `/v3/groups/2586c5113e84445e878f22c79629f416` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.093242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] RBAC: Authorizing `identity:get_group(group_id=2586c5113e84445e878f22c79629f416)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:46.094711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:46.096815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 208/413] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:45 2022] GET /identity/v3/groups/2586c5113e84445e878f22c79629f416 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:46.104096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:46.217077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e077-99ad-4080-accb-d93932407b7d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:46.255701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:46.256618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.256893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.257203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] PATH_INFO: `/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.258480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] RBAC: Authorizing `identity:get_project(project_id=9ea94fb17e4549a0aa68e4ab8008eb33)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:46.260124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225b97a-6a6e-4959-846d-51d3ff0be764 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:46.262032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 206/414] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:46 2022] GET /identity/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:46.267655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:46.281302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c40e5-76bb-445a-a5ca-81ddaf001214 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.281604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c40e5-76bb-445a-a5ca-81ddaf001214 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.281886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c40e5-76bb-445a-a5ca-81ddaf001214 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.283518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 207/415] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:46.289983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.290498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.290881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.327041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:46.330188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:46.403322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a880973-e294-48b1-a869-674aaa7b15c7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:46.421911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 208/416] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:46.440720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:46.441966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.442417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.442840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] PATH_INFO: `/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33/groups/2586c5113e84445e878f22c79629f416/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.445595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ea94fb17e4549a0aa68e4ab8008eb33, group_id=2586c5113e84445e878f22c79629f416, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:46.447196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:46.454433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:46.545340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 209/417] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 11 12:38:46 2022] PUT /identity/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33/groups/2586c5113e84445e878f22c79629f416/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:38:46.563524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea54ae-b66c-4f4b-8fb5-0fe4d757ad32 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:46.608856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:46.609697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.609977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.610246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.625440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:46.634324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:46.635572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:46.636350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:46.640709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 209/418] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:46.642167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:46.848810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16938353-077f-4d15-bc32-4f75078ed9f9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:46.906807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:46.907484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:46.907814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:46.908092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:46.908839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] RBAC: Adding query filter params (name=member) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:46.909171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:46.910648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:46.924254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 210/419] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:46.930295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.049066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7db39-1a94-497e-ade4-e9db5f4439e1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:47.089361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:47.090033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.090315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.090592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.164966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:47.166667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97445d-b0dc-40c8-8a31-59c55c5f6099 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:47.268905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 210/420] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:47.275933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.316455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2a63-6e9f-4871-b857-fd63915e3fd5 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.316754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2a63-6e9f-4871-b857-fd63915e3fd5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.317003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc2a63-6e9f-4871-b857-fd63915e3fd5 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.318546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 211/421] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:47.323504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.323790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.324065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.349274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:47.351064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:47.439881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 212/422] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:47.451932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f03c8-02b4-458a-b253-2c2712c2a040 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:47.472414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.490723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:47.493553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.494041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.494608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.496050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:47.497930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:47.500214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 211/423] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:47 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:47.505500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.662322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29442-b32b-44d5-ae8a-b4fd87058c93 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:47.703180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:47.704046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.704330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.704606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.707823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbf451-8e4b-4508-82b5-f634310d4e23 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:47.710465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:47.712084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:47.715584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 212/424] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:47 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:47.726652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.786903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:47.787767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.788053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.788319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.821718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:47.837929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:47.838821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:47.840032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 213/425] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:47.844550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b46229-313b-43b6-ab85-ebcb9c17a4de None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:47.844762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:47.883250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:47.884321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:47.885142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:47.885608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:47.886641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=22c5658eb7fb4c758ff6cac952410994) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:47.887142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:47.897061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:47.904371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 213/426] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:47 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:47.971618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c1a91-7fc9-4bf7-b441-c2a2381acf9f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.008912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.009735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.010347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.010661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.011535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:48.011889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.013563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927adb3-aaf0-41e4-89e6-45db4d767efd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.028829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 214/427] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:48.034194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.060490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6aac8-2e18-43cc-8071-54084f8226c1 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.060792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6aac8-2e18-43cc-8071-54084f8226c1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.061066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6aac8-2e18-43cc-8071-54084f8226c1 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.062923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 215/428] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:48.070498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.070796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.071051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.099999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:48.102208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:48.228968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 216/429] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:48.229991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25bcb8-0b21-44e8-b096-cdcf571ec561 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.252882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.269947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.271092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.271427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.271707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.361882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.362794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddebd3-f2be-4c79-9a48-8c83d9b836d0 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.363451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.403085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.403880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.404213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.404502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] PATH_INFO: `/v3/roles/member` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.418211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:48.426496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:48.429659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 12:38:48.431655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:48.437592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 217/430] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:48.437592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.489610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 214/431] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:48.496938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.555231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142e792-3346-4a6f-80e9-68bb504aedca None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.589188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.589865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.590148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.590424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.591183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] RBAC: Adding query filter params (name=member) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:48.591492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.592889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.601631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 218/432] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:48.604529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeff5ed-49f9-4517-bc59-7cbe08ebe896 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.607072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.643801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.644680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.644959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.645276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] PATH_INFO: `/v3/projects/22c5658eb7fb4c758ff6cac952410994` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.646512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] RBAC: Authorizing `identity:get_project(project_id=22c5658eb7fb4c758ff6cac952410994)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.648156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.650203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 215/433] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/projects/22c5658eb7fb4c758ff6cac952410994 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:48.655487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.726087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de90c3-98d3-473e-aa50-06463c667b33 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.770166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.770741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.771022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.771301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.784587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e19c-d42e-4467-85e5-d48dff3f8b5e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.833908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.834982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.835643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.835861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.837574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.839018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ef18f-0465-4bf3-b752-2ed7a75930bc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.841020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 216/434] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:48.842320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d4da-0496-4c18-8868-5c849f0a0052 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.842607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d4da-0496-4c18-8868-5c849f0a0052 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.842894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d4da-0496-4c18-8868-5c849f0a0052 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.844107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 217/435] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:48.846440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d4da-0496-4c18-8868-5c849f0a0052 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:48.855582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.857833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a095c62-0f39-4ab3-ba32-79e30993609d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:48.954665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d4da-0496-4c18-8868-5c849f0a0052 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:48.956709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 219/436] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:38:48.958085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.958384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.958641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.975588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:48.977118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:48.994479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:48.995137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:48.995419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:48.995692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:48.996513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=22c5658eb7fb4c758ff6cac952410994) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:48.996822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:48.998296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.004530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 218/437] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:48 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=22c5658eb7fb4c758ff6cac952410994&role.id=fa903e57f2f4461fb91b94163f747824 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:49.005186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.057771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 220/438] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:49.080724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.143418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c15ec-e427-4ade-a871-e8cd22ad49b3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.199554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.200105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53aeb-51f4-4d78-8b3a-addd41b65f09 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.200448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.200730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.200999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.202933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.204375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.206149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 219/439] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:49.212406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.246541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.247180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.247396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.247671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.263988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:49.273312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:49.274481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:49.275269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 221/440] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:49.280033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.355508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426fb00-27bd-4b08-8ae9-a69a49a3b436 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.391370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.392224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.392503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.392953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.394320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.395399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777ef31-9a86-478f-af37-9e82f1627284 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.398641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 220/441] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:49.399120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189049e-a74d-4148-a9d3-65ea32d2caaa None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.399263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be3ef-0d24-49da-8ce6-0eb8a9663cb6 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.399528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be3ef-0d24-49da-8ce6-0eb8a9663cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.399803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556be3ef-0d24-49da-8ce6-0eb8a9663cb6 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.401287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 221/442] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:49.404528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556be3ef-0d24-49da-8ce6-0eb8a9663cb6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.445546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.446220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.446501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.446772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.447515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:49.447824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.451491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7b9ea-d128-4fa7-983e-8ccef4a3d1c2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.460247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 222/443] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:49.461849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.462164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.462509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.479022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:49.480207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:49.512250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556be3ef-0d24-49da-8ce6-0eb8a9663cb6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.544589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 223/444] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:49.544993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.545448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.545813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.546013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.546344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.547203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=b0bbf919a58b47ed9dae65f2ea7472f0, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:49.547519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.549060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.555186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 222/445] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=b0bbf919a58b47ed9dae65f2ea7472f0 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:49.567760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.663310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376640fb-633d-4196-8ff6-d78db4d83a86 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.673900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b411d-b3e7-4c91-b6d1-0ba970f3ce34 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.703143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.703831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.704116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.704383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.714300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.714300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.714300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.714300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.725670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:49.733469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:49.734389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:49.735259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 223/446] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:49.740610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.793785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.795285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.858724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ebb3-77d9-4f95-a9f7-ac5c9e4588af None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:49.899471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:49.900143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:49.900427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:49.900708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:49.901492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:49.901804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:49.903185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:49.911810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 224/447] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:49.914005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 224/448] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:49.917652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:49.919174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.041529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b726f5-2e53-4eef-9fe8-d0f54074e7cf None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.056522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2eb263-426f-4630-a5ef-f4bf7749f61c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.084135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.085629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.085919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.086191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] PATH_INFO: `/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.087396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] RBAC: Authorizing `identity:get_project(project_id=bd21b760fb0c4202b8c1caf5a0a17cb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.088827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.090553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.090688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 225/449] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/projects/bd21b760fb0c4202b8c1caf5a0a17cb9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:50.091415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.091770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.092058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.096087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.164504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.165918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.190985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff42c8-fcdb-4cb6-83a2-63913c82e227 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.223704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.224552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.224833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.225169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] PATH_INFO: `/v3/groups/af9a2c210ef64fe3b392fecf76497266` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.226355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] RBAC: Authorizing `identity:get_group(group_id=af9a2c210ef64fe3b392fecf76497266)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.227809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.229489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 226/450] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:50 2022] GET /identity/v3/groups/af9a2c210ef64fe3b392fecf76497266 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:50.235055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.260125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 225/451] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 12:38:50.265851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.328488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3490a39-3358-4423-8a34-6b4aaf865228 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.360488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.360708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261d3a0-0de8-473c-9861-76e29cb0018b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.361184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.361476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.361759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.362642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] RBAC: Adding query filter params (group.id=af9a2c210ef64fe3b392fecf76497266, role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:50.362954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.364439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.370421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 227/452] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:50 2022] GET /identity/v3/role_assignments?group.id=af9a2c210ef64fe3b392fecf76497266&scope.project.id=bd21b760fb0c4202b8c1caf5a0a17cb9&role.id=fa903e57f2f4461fb91b94163f747824 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:50.396887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.398620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.398901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.399173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] PATH_INFO: `/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.400470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] RBAC: Authorizing `identity:get_project(project_id=9ea94fb17e4549a0aa68e4ab8008eb33)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.401996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.403807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 226/453] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:38:50 2022] GET /identity/v3/projects/9ea94fb17e4549a0aa68e4ab8008eb33 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:50.409609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.514127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd94c6-017f-4c65-aeeb-c409cb9b8189 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.548352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.549240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.549524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.550587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] PATH_INFO: `/v3/groups/2586c5113e84445e878f22c79629f416` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.550984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] RBAC: Authorizing `identity:get_group(group_id=2586c5113e84445e878f22c79629f416)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.552387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0929e5-cfcf-4cca-9825-e8645b66d1f6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.555115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 228/454] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 11 12:38:50 2022] GET /identity/v3/groups/2586c5113e84445e878f22c79629f416 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:50.561286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:50.660676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c966-c93d-4738-a511-98f2086df87f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:50.696107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:50.696770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:50.697081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:50.697359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:50.698187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] RBAC: Adding query filter params (group.id=2586c5113e84445e878f22c79629f416, role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=9ea94fb17e4549a0aa68e4ab8008eb33) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:50.698502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:50.699934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3587-e452-4288-8b27-45677b4067d4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:50.705967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 227/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 11 12:38:50 2022] GET /identity/v3/role_assignments?group.id=2586c5113e84445e878f22c79629f416&scope.project.id=9ea94fb17e4549a0aa68e4ab8008eb33&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:53.318984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8490d-82cf-43ac-8b81-fe3a13f22a3e None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.319551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8490d-82cf-43ac-8b81-fe3a13f22a3e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.319551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8490d-82cf-43ac-8b81-fe3a13f22a3e None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.321133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 229/456] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:53.326654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3af3-a4e1-4f4d-9020-ba767d544787 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.327478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3af3-a4e1-4f4d-9020-ba767d544787 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.327950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d3af3-a4e1-4f4d-9020-ba767d544787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.349342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-761d3af3-a4e1-4f4d-9020-ba767d544787 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:53.351823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-761d3af3-a4e1-4f4d-9020-ba767d544787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:53.446645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 228/457] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:53.471226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8490d-82cf-43ac-8b81-fe3a13f22a3e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:53.610966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8490d-82cf-43ac-8b81-fe3a13f22a3e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:53.634599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ce6-6e02-4468-a521-993fb2795f9a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.635510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ce6-6e02-4468-a521-993fb2795f9a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.635979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981ce6-6e02-4468-a521-993fb2795f9a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.639066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 229/458] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:53.643354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.643883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.644350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.657788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:53.658597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.658884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.659165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.665380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:53.666836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:53.672082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:53.681858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:53.716967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:53.717919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:53.718731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:53.718731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:53.718731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:53.718731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:53.728868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 230/459] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:53.734923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:53.785556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 230/460] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:38:53.810914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:53.868999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0805b1-a1c5-4284-af15-9154a1807635 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:53.906738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:53.907403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.907688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.907965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.908688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:53.908994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:53.910482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7c850-778b-4319-b316-c59db8c99862 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:53.925785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 231/461] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:53.927116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252cb5-ca2c-4e21-93cd-2e0f46205469 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:53.927402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252cb5-ca2c-4e21-93cd-2e0f46205469 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:53.927679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252cb5-ca2c-4e21-93cd-2e0f46205469 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:53.929351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 232/462] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:53.930879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252cb5-ca2c-4e21-93cd-2e0f46205469 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:53.972561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e91eaf-9ef4-4177-8b7b-efab3ceafcfd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.012519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.013991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.014778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.015218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.029258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.031632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.041962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252cb5-ca2c-4e21-93cd-2e0f46205469 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-52f01aa6-eef3-4860-8671-a9c6cd033fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:54.055142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:54.056191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:54.057408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:54.057408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:54.057408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.057408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:54.059419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 231/463] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:54.061538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.061974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.062721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.081393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:54.081573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.082186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.082478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.082571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:54.082760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.083440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.085556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb18dd-09a9-429d-9832-0b485f8b94ef None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.157105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 232/464] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:54.157105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.189592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 233/465] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:53 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:38:54.190972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbff8-9139-4f62-a13e-de539f9025dc None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.191259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbff8-9139-4f62-a13e-de539f9025dc None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.191534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbff8-9139-4f62-a13e-de539f9025dc None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.192933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 234/466] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:54.197998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bbff8-9139-4f62-a13e-de539f9025dc None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.274098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f8f0-6c0c-4ce9-b8d6-6880b84aecf9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.319648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.320800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.321312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.321802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.322750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:54.323259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.324893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089af08-b1ad-48d3-8637-079a433c55f4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.337345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bbff8-9139-4f62-a13e-de539f9025dc None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.339407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 233/467] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:54.341290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.341837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.342332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.360092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:54.361844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:54.383397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.384547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.385318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.385790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.399537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.401332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:54.418920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:54.419867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:54.420902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:54.420902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:54.420902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.420902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:54.422768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 235/468] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:54.423677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.436158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 234/469] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:54.436998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.532220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30454804-ebe8-483a-b344-dbe6311afed1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.549959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41445d78-9d66-4208-b8b8-2d3b1b67e0dd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.567192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.567862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.568144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.568419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.570166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.571750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.591003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.592039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.592323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.592596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.593700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:54.594125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.595668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.609469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 235/470] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:54.611464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.686130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 236/471] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:54 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:54.688114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:54.752618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ae089-137f-45c6-a34f-e44d003a1e12 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.814582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d835d-faed-4d2a-a04d-25d5c2a71345 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:54.830831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.832000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.832473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.832957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.855769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.857292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.859777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:54.860471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:54.860759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:54.861060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:54.861788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:54.863459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:54.889772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:54.891246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:54.892093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:54.892093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:54.892093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:54.892093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:54.892093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 236/472] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:54.898338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:55.005636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 237/473] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:54 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:55.016930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564cb5-4ee1-4c31-b895-b9238e0270d0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:55.060556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:55.061517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.061938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.062347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.063254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:55.063701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:55.065313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8069f5-7900-461e-a9bb-51d99760cd85 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:55.080960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 237/474] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:55.090564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:55.158163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e337f-7f50-4141-8b89-4704060bede8 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.158499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e337f-7f50-4141-8b89-4704060bede8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.158830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e337f-7f50-4141-8b89-4704060bede8 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.160348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 238/475] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:38:55.166469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.166770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.167025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.194201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:55.196711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:55.236338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315380ec-faf2-44a6-90bd-b3bb6b709d8a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:55.279440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 239/476] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:55.286795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:55.288270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.288598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.288919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.289770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:55.291440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:55.304647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:55.381873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 238/477] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:38:55 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:38:55.410049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50468-c126-4c38-ab1a-bca327898692 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:55.452390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:55.452390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.452390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.452390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.452808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:55.453079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:55.495308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.sql.core [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 12:38:55.495308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 12:38:55.495308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [parameters: {'id': 'fd9a981a0dc2407b9a84292b998b1387', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 12:38:55.495308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91838) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application conn.query(q) May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application result.read() May 11 12:38:55.512906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return ref.to_dict() May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:38:55.513854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application next(self.gen) May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application yield resource May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application next(self.gen) May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self.session.rollback() May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self.force_reraise() May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise self.value May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application session.commit() May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 12:38:55.515282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._prepare_impl() May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self.session.flush() May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._flush(objects) May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application compat.raise_( May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application flush_context.execute() May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rec.execute(self) May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 12:38:55.517395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:38:55.524579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application conn.query(q) May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application result.read() May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:38:55.526557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [parameters: {'id': 'fd9a981a0dc2407b9a84292b998b1387', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:55.528449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 12:38:55.530419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:55.532355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 240/478] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 11 12:38:55 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:55.532488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:55.660728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93640e-9f51-4398-93b0-c2c5d4a5f8b0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:55.702969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:55.704070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.704550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.705058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.716211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7673abc4-ab43-4212-ac72-b12dd1bc1ba4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:55.725411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:55.726697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 12:38:55.727517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:55.730294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 239/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:55.735593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:55.849273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa464-3309-4961-ab3c-f32496651030 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:55.890812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:55.891819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:55.892296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:55.892762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:55.893759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:55.894285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:55.895846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256471a-ab3c-41b2-847a-29618e74dbc5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:55.905130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 241/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:57.035385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db0ec-e3e8-418f-9c24-2826621c3475 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.036349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db0ec-e3e8-418f-9c24-2826621c3475 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.036850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db0ec-e3e8-418f-9c24-2826621c3475 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.038836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 240/481] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:57.044230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.045120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.045596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.066738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:57.068262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:57.154190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 242/482] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:57.194137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db0ec-e3e8-418f-9c24-2826621c3475 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:57.324133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db0ec-e3e8-418f-9c24-2826621c3475 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:57.373751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:57.374550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.374834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.375111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.398269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:57.406291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:57.407114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:57.408303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 241/483] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:57.414342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:57.527709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2386b-cf6c-474e-86b2-18f8ab17e140 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:57.577635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:57.578646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.579122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.579606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.580848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:57.581371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:57.582939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd08a6-64a9-4666-82a7-f6b821715a87 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:57.597719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 243/484] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:57.603441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:57.651961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d907e-dd3f-4094-a0ed-7eab4f55ae08 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.652617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d907e-dd3f-4094-a0ed-7eab4f55ae08 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.653115 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d907e-dd3f-4094-a0ed-7eab4f55ae08 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.654976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 244/485] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:57.665799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.666420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.666911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.684001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:57.685509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:57.768215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 245/486] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:57.793878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e1ad8-469b-4fc7-9218-236b3c484aa6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:57.813966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:57.858747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:57.858747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.859055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.859173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.877199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:57.878661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:57.909337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:57.910235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:57.911057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:57.911057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:57.911057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:57.911057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:57.913579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 242/487] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:57.922703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:57.926044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5626416-0bf3-4934-a53f-bac5b170e3d3 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:57.961633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:57.962813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:57.963286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:57.963747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:57.975865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:57.984528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:57.985521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:57.986317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:57.989228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 246/488] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:57.995091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.122669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499cd5a4-8e03-45d2-9b41-3f666e3a2168 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.194714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.195006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a3ed7-72de-4280-978e-9daad52b40cc None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.195566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.195898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.196341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.198029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:58.198344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.199755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b1b5e-9b4c-4ecb-9949-05fc7e30cc0f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.216528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 243/489] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:58.218319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168a98-ad91-43ea-b94e-fd086a3c4fe3 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.218607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168a98-ad91-43ea-b94e-fd086a3c4fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.218881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7168a98-ad91-43ea-b94e-fd086a3c4fe3 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.220372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 244/490] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:58.221725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7168a98-ad91-43ea-b94e-fd086a3c4fe3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.242239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.243076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.243360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.243935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.244689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:58.244997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.246853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035763e8-abca-4bbd-bfa7-438fa4b0c1f0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.261210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 247/491] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:38:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:38:58.263316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.263609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.263885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.280796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:58.282014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:58.337993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7168a98-ad91-43ea-b94e-fd086a3c4fe3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.357226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 248/492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:58.357226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.384397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.385405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.385685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.385956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.392963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.394425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-1410fd0f-6e43-436a-a924-a59b0ca18256 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:38:58.411037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:58.411954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:58.413636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 245/493] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:38:58.414187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326abe-b8e9-43e3-b869-54107044e168 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.414909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326abe-b8e9-43e3-b869-54107044e168 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.414909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db326abe-b8e9-43e3-b869-54107044e168 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.416095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 246/494] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:58.420596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db326abe-b8e9-43e3-b869-54107044e168 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.454527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e93750-43e4-413d-a2a5-3fb633eb33fd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.491822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.492623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.492916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.493210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.504207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.505714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.522114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db326abe-b8e9-43e3-b869-54107044e168 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:58.525554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:58.540377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 249/495] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:58.541408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.563390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.564187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.564468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.564760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.578599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3720dc00-8afe-4f57-9e16-3f18cd999e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:58.587392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:58.588272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 247/496] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:58.596279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.597204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.597204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.610671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:58.611857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:58.644334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3ace-dba2-4760-be6d-d6a28f2f20f8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.678074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 248/497] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:58.678926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.679543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.680296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.680655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.681006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.681941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:58.682349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.683872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.723222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 250/498] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:58.724056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.787674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa0dc-6ed7-4126-9e09-b5c301adb745 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.821328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.821985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.822276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.822552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.823276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:58.823581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.824958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.825080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa514-e497-4d97-91fe-67675c7a5814 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.837020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 249/499] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:58.837852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.858365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.859034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.859315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.859586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.860324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:58.860629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:58.862062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d5d3b-b0a2-4280-841a-d607bb5834f1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:58.870534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 251/500] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:58.871756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2df75-f785-43da-9893-1b0f855116c7 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.872042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2df75-f785-43da-9893-1b0f855116c7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.872319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2df75-f785-43da-9893-1b0f855116c7 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.873811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 252/501] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:38:58.874272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2df75-f785-43da-9893-1b0f855116c7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:58.934807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe8797-247f-4123-b2df-778f7248b839 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.966241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:58.967020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:58.967300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:58.967570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:58.972030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2df75-f785-43da-9893-1b0f855116c7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:58.977384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:38:58.984910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:58.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:58.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 250/502] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:58.987349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.007106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.007789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.008072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.008350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.071982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.073772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643055d-cca4-40a0-8452-fffc3b1b676b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.085431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a9247-a25f-4f11-941f-6ab91e69f9dc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.117535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.118409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.118707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.118983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] PATH_INFO: `/v3/users/glance` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.137620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.139083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:38:59.158530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:59.159567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 12:38:59.160433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:59.161501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 251/503] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:59.163156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.174859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 253/504] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:59.174859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.174859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.174859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.188814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:38:59.189962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:38:59.254224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 254/505] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:38:59.255093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.257759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f37b1a-4353-46fb-bd71-a9aab160ba9f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.290986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.291762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.292043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.292317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.302391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.304018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:59.322361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:59.323224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:59.324034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:59.324034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:59.324034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.324034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:59.324034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 252/506] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:59.324693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.352909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7e5b9-6b93-42ad-838f-96d4de49b5fa None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.385412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.386069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.386347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.386617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.387351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:59.387653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.389027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.397668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 255/507] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:59.398482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.418726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5d460-28cf-4168-8840-48a80064a7f9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.450233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.450829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.451114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.451390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.452221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:59.452533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.453994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.490614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 253/508] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:59.491430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.493456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10de5dc-a0ec-4701-8949-6be3514ff4f0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.527662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.539087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.539087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.539087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.539087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.540547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:59.557211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:59.558138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:59.558958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:59.558958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:59.558958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.558958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:38:59.558958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 256/509] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:59.559211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.594025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570682e-2992-442d-8149-7bde2eaa68a8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.626153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.626930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.627218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.627483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.638008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.639465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.654495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce6c4-c46e-420c-879e-b874fa6a688f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:59.656194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:59.657009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:59.657869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:59.657869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:59.657869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.657869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:59.657869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 254/510] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:59.658143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.686792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.687462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.687745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.688020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.688734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:59.689068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.690430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.702687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 257/511] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:59.703463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.758004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71423467-a5cc-4a5c-bd6c-d4497bf66c72 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.789617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.790398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.790684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.790959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.798169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223ea6-6cd7-4637-8f2e-87b0287afe71 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.800962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.802432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:38:59.819910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:38:59.820773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:38:59.821701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:38:59.821701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:38:59.821701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:38:59.821701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:38:59.821701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 255/512] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:38:59.821955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.831841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.832501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.832787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.833092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.897482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.898958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.914585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc096f2b-9ee2-4bf7-aa44-2a0add5e8df6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:38:59.946498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:38:59.947149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:38:59.947434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:38:59.947706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:38:59.948418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:38:59.948725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:38:59.950127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:38:59.961488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 256/513] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:38:59.962299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:38:59.994302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 258/514] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:38:59.995868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.062361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25f159-5dba-47d5-9409-dfb1712defe7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.090407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc889-7b8f-4007-acab-221d8d430f19 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.095579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.096234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.096521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.096798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.097547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:00.097855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.099258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.112346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 257/515] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:00.113295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.128386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.129226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.129514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.129791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.137112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.138571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:00.154159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:00.155035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:00.155944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 259/516] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:38:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:00.156494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.215894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175ee3b-d2df-4290-b7b3-e86c1c5e5a8a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.248991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.249671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.249954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.250227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.250932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:00.251233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.252710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.256503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf8438-7ae5-4062-9cbd-befdea5c85b0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.264588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 258/517] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:00.265398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.289392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.290181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.290457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.290728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.297085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.298704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:00.314151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:00.315024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 260/518] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:00.320721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.364507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3505f5-94fb-43d8-8185-2b2b0f65aa41 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.397233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.398019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.398297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.398570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.408100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.409584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.413839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181adb4-1cf8-409e-9d64-a7e7a8f5633c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:00.426986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:00.428026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:00.428898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:00.428898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:00.428898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:00.428898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:00.428898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 259/519] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:00.429260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.449238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.449903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.450186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.450458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.451148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.452618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.533100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090f527-b022-4294-9671-af3a93cc81d8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.565428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.566082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.566371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.566651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.567519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:00.567832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.569431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.586397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 260/520] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:00.587173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.592235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 261/521] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:39:00 2022] POST /identity/v3/users => generated 247 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:00.593179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.695552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aefa52-742c-4624-8861-881a8ed086bf None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.704367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3da28-d59d-44f8-9316-342a6e9cfd5e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.735030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.735991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.736378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.736755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.740791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.741502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.741789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.742067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.742869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:00.743179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.744665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.745539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.747115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:00.764343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:00.765520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:00.766573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:00.772713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 261/522] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:00.772713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.772953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 262/523] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:00.772953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.874942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af85b59-dea2-4b71-988f-a58b2dad2703 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.878879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b97625-6f9c-42b2-93bc-b34a6128cc03 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:00.909162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.909823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.910109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.910388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.914599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:00.915492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:00.915932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:00.916359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:00.917376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:00.917821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.919395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:00.931028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:00.932057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:00.977141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:00.978632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.033860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18b0d9-5622-4ed6-8324-4540e8bb1f88 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.066036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.066742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.067036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.067316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.068147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:01.068979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.070500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.076446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 263/525] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:01.077494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.085277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 263/526] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:00 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:01.086380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.188238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a469a0-74d2-4820-bb15-ed15f465d552 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.198110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e8312-974d-4187-8cae-2c8f1790be2f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.228967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.229995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.230484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.230928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.231945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:01.232426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.234107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.235155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.235976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.236261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.236537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.244557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.246139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.261107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 264/527] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:01.262091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:01.262896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:01.263687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 264/528] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:01.264452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.265139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.367428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf019bb-a29f-461c-a202-a8f5b4c7acfc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.376485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7a372-a6be-4329-904a-a7ae1c0c47c8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.403226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.404111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.404560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.404973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.411391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.412938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.413268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.413544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.423934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.425455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:01.444199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:01.445273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:01.446258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:01.446258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:01.446258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:01.446258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:01.446258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 265/529] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:01.446539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.478220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.480033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.548575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d77e2-cb93-4bc3-8390-7101b6368a81 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.583877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.584551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.584841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.585149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.585943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:01.586253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.587715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.595825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 265/530] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:01.596941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.600286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 266/531] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:01.601688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.701125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f76a-a097-49c4-8e6a-c0f7b9a5740e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.704046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a38f56-9e69-461b-b421-2e38aeae0e1e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.738721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.739518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.739802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.740133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.741856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.742662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.743080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.743490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.744470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:01.744984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.746633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.752735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.754697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.758913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:01.760313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:01.776045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:01.776998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:01.778161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:01.778161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:01.778161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:01.778161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:01.778161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 267/533] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:01.778433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.879928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19e41-ef5f-4e2b-ac72-a0bd55bc06da None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.903921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb611b-8b3a-4cd2-ac31-29a0a63160b5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:01.916160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.916820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.917130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.917412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.918243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=752019a13ba44236ba1c1e13aea6129d) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:01.918558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.919978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:01.933078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 267/534] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/role_assignments?user.id=752019a13ba44236ba1c1e13aea6129d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:01.933078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:01.974071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:01.976040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:01.976539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:01.977004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:01.994285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:01.996088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:02.033070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:02.034064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:02.034867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:02.036316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a03-68df-463f-afb4-1363f21f886b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.038284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 268/535] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:02.043551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:02.085685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.086368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.086649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.087653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:02.087958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.089493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.120707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 268/536] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:02.126188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:02.198080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f14877-1714-48c7-bf65-0a81671914df None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.249151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.249151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.249151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.249462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.250104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:02.250415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.253453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.267831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 269/537] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:02.278049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:02.289912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab593fe5-f49d-440c-a7b4-574454972087 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.345115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.346064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.346354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.346634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.355098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.356561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:02.371942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:02.372800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:02.373661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 269/538] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:02.383646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:02.462074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502b904-907f-4b81-a1be-ad237a9c6f71 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.526006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df913db-31e1-41ba-8d76-ac88e84ab83f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.526385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.527437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.527938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.528412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.529471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=eee618b771c149d98b108e389c511acf) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:02.529994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.531719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.541123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 270/539] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:02 2022] GET /identity/v3/role_assignments?user.id=eee618b771c149d98b108e389c511acf&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:02.575395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.576384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.576851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.577356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.584384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:02.584384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.584384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02260-93e2-4e11-8b23-45d80a45bac2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.603183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 270/540] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:02.610207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:02.742406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530722ee-644a-4ef9-a41a-753453dd8dd5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:02.792821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:02.793451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:02.793740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:02.794014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:02.794862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9a8e3bf8abe544a98ba074737674ab93) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:02.795177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:02.796635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee5f49-8073-46af-a48d-3519d2c6e021 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:02.803637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 271/541] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:02 2022] GET /identity/v3/role_assignments?user.id=9a8e3bf8abe544a98ba074737674ab93&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:03.318793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d725c-7f07-45cf-91ec-673dd79ccacf None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.319414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d725c-7f07-45cf-91ec-673dd79ccacf None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.319414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d725c-7f07-45cf-91ec-673dd79ccacf None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.321020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 271/542] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:03.326518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.326974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.327056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.344647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:03.345937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:03.417651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 272/543] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:03.440962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d725c-7f07-45cf-91ec-673dd79ccacf None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:03.556877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d725c-7f07-45cf-91ec-673dd79ccacf None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:03.591601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:03.592400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.592684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.592957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.604403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-bc639afc-f285-4b57-90e0-c6119feb97f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:03.612210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:03.614339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:03.616324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 272/544] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:03.625119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:03.669785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b07a96-5aab-4d42-be5b-a492147c5002 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.670104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b07a96-5aab-4d42-be5b-a492147c5002 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.670346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b07a96-5aab-4d42-be5b-a492147c5002 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.671989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 273/545] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:03.687004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.687004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.687426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.715643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:03.716871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:03.782557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df24b65-1205-4248-a464-3034aa12ec53 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:03.851165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:03.851781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:03.852065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:03.852346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:03.853154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:03.853473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:03.854919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:03.858758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 274/546] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:03.867697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 273/547] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:03.872998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:03.889612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.010316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac6222-2583-4291-abc9-b9509f5f831a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.048585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.049417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.049704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.049984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.058916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29aaa-52af-4178-988d-31520e4370a1 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.072450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:04.080282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:04.081185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:04.081959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:04.086460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 274/548] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:04.091511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.142932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.143649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.143934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.144210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.171143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.173855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:04.201995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:04.204005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:04.206081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:04.206081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:04.206081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:04.206081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:04.206081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 275/549] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:04.209529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.254873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93a14-5b8d-4cd5-aabe-e59a90c032e1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.305908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.306489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.306774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.307042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.308138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:04.308643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.310530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.324459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 275/550] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:04.329522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.355620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec9d7-02f0-418c-9e2a-5f0eec3fedde None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.394240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.395249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.395743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.396756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.398015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:04.398525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.400303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.414067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 276/551] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:04.419462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.515921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2719bf4-45c2-4a95-8bd4-c16c7bfafbfa None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.576026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.577187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.577657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.578097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.584861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad68172-1ffa-4123-81a0-c520fa4c60c7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.589456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.591173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:04.609072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:04.609938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:04.610728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:04.610728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:04.610728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:04.610728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:04.612975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 276/552] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:04.619219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.637795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.638565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.638851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.639126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.654067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.655475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:04.684265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:04.685266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:04.686133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 277/553] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:04.692110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.737081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e5063-b394-49f0-95ae-0b292c823a9f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.772164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.773242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.773734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.774207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.775117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:04.775632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.777246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd08da9-ba45-4ac5-8b9a-c8ed245e7edc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.791468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 277/554] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:04.793631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3acc8-0a35-41b7-a578-7f0bad81e65f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.794131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3acc8-0a35-41b7-a578-7f0bad81e65f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.794617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3acc8-0a35-41b7-a578-7f0bad81e65f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.796051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 278/555] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:04.798303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3acc8-0a35-41b7-a578-7f0bad81e65f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:04.860230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10830b31-3d3d-425a-9e4d-3b79f9a6bc0f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.903653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.904383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.904616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.904892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.905795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:04.906103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.907617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06e366-088a-4f32-9b1e-4ff931fd94d8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.908470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3acc8-0a35-41b7-a578-7f0bad81e65f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:04.933205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 278/556] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:04.934888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.935180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.935451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.955248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:04.956437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:04.957916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:04.960492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:04.961099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:04.961574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:04.970838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:04.973199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:04.993706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:04.994637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:04.995504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:04.998215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 279/557] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:04.999185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.031688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 279/558] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:05.032905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.144761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7899f-6868-4bdf-bd66-95e96e681592 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.164815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163791c9-ec9b-499f-82e5-78eb60e00c7b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.191871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.192732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.193826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.194233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.206681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.207775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.208757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.209255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.210828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:05.211420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.213906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.233629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 280/559] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:05.234764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.272315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.273799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3d54f-2cbe-43f4-8cee-e139b1511be7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.335595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930c270-4ad3-4bfa-ac7e-d9ca13733151 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.369782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.370571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.370853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.371127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.376236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 280/560] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:05.376236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c3a8-6bbe-4d7c-8a94-c8a347a15e52 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.376236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c3a8-6bbe-4d7c-8a94-c8a347a15e52 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.376236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c3a8-6bbe-4d7c-8a94-c8a347a15e52 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.376236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 281/561] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:05.376952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099c3a8-6bbe-4d7c-8a94-c8a347a15e52 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.386278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:05.394090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:05.395024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 281/562] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:05.397022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.490588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099c3a8-6bbe-4d7c-8a94-c8a347a15e52 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.500248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bbc51-12e9-413c-a088-a765600edd0f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.529685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.530511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.530785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.536229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.537130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.538389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.538676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.538950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.541151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.542612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.551356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.553303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-23370e72-14bf-4e32-837c-597112ebee5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:05.559701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:05.560716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:05.561685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:05.561685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:05.561685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:05.561685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:05.565475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 282/563] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:05.566740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.567031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.567303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:05.572485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:05.574119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 282/564] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:05.576173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.601628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:05.602816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:05.667830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 283/565] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:05.668664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.684399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b2ef3-51da-4751-bd00-de5e5bc35939 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.718010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.718677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.718963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.719240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.719986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:05.720294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.721687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.729401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 283/566] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:05.730178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.768071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6cb54-02b1-4e35-98a0-753bc98c08f9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.801837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.803014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.803298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.803778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.804507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:05.804816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.806247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c03e8-7fbf-49fd-85b5-c5f50980cb93 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.817256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 284/567] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:05.819233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669733b-4941-48e2-9b17-843d474fcf56 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.819532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669733b-4941-48e2-9b17-843d474fcf56 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.819806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669733b-4941-48e2-9b17-843d474fcf56 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.821079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 285/568] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:05.822064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669733b-4941-48e2-9b17-843d474fcf56 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.836008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcdeb7-e76f-4a2e-acde-9c73419525aa None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.867839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.868505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.868795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.869104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.869831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:05.870142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:05.871499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:05.883641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:05.884426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.919582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669733b-4941-48e2-9b17-843d474fcf56 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:05.951997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:05.952782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:05.953088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:05.953365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:05.963127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:05.970820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:05.971899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:05.978248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:05.979992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aceb7f-41a4-451f-8db1-17b69404488c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.012553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.013391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.013675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.013953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.023753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.025178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-864b9f1e-7aa5-4bb8-9f1b-beb00ab33af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:06.042352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.043387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 285/571] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.045248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.045661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.045661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.062408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:06.063603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:06.071450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe6a7d-5128-4344-92ee-abeca1d459a2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.103981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.104851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.105169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.105444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.111893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.113368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.127058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 286/572] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:06.127883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:06.128159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.129111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:06.129988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 287/573] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.131163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.231301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc88a0-b77a-4294-9780-b7c5ec2ff322 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.232618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccadfc-e503-46a5-8f75-f489a1fb9903 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.264077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.264865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.264970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.265178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.265456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.265547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.265830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.266107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.266845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:06.267152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.268520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.272574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.274101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.277067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 288/574] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:06.277866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:06.288245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.289326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 287/575] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.290876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.375509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16fcc2-d387-4413-9c99-e221e22ab71b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.387446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718f07-4ffd-464e-8cc3-207804eaf009 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.407328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.407987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.408267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.408538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.409286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:06.409629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.411134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.420114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.420763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.421063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.421357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.422136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:06.422446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.423755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 289/576] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:06.423894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.424529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.436238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 288/577] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:06.437067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.518498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b887bd-ec3c-4e03-98a8-5c9b3e61a915 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.529439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45430e-33fd-471b-9746-9a71a886ae5b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.551659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.552622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.552860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.553246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.561459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.562242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.562526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.562805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.563264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:06.571400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.572345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:06.573207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:06.573898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.574150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.578388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 290/578] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.578388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:06.591948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.592910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.593845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:06.593845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:06.593845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:06.593845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:06.593845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 289/579] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.594123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.691949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789189c-a6ac-4ca5-a6d9-dbe978c38246 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.695897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5eeba-fa52-47ad-8597-6b23f20a8372 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.726771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.727619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.727899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.728213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.729910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.730565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.730851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.731128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.731906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:06.732218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.733719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.735207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.736616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.745442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 291/580] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:06.746198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:06.750886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:06.751979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 290/581] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:06.752905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.843304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5837c-90e3-4e95-8ac1-4ac7fcc49654 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.850882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e242f2-c54a-4056-9a80-a6801d67b492 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:06.875512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.876386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.876664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.876931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.884355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:06.885293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:06.885579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:06.885855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:06.886594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:06.886903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.888262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.891858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=9bd3d5788bc74f70a942f44f2f38dfca, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:06.893538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:06.898054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 291/582] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:06.898978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.968710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 292/583] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:06 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:06.969658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:06.995902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfce87-efb7-4686-9794-94f5133cfbb0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.033335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.034026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.034308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.034581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.035322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.035620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.037173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.054018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 292/584] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.054779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.096460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac53f0-e80a-4d28-8bb9-1580984b154f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.137641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.138322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.138801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.138911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.139770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=4584309e6ee74080b5b3bc63eacdab4c) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.140029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.141534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.157305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 293/585] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:06 2022] GET /identity/v3/role_assignments?user.id=4584309e6ee74080b5b3bc63eacdab4c&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.157305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.176646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6fd5b-bd7e-406e-86dd-53fed8c39112 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.216074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.216912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.217355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.217732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.218700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.219114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.221203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.241193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 293/586] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.246226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.282918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7edfb-ef47-4128-b10c-debfce72a3ee None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.328815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.329865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.330295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.330663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.342766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.343933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.357145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aaedfe-439a-4b9a-9bd5-f5e3821f3a15 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:07.364043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:07.365693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:07.366762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:07.366762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:07.366762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.366762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:07.366762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 294/587] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:07.371939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.392999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.393909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.394226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.394504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.402493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.403952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:07.419122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:07.421420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 294/588] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:07.423767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.481072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5add91-e216-4485-bcc6-90a0d6e5010d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.516320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.517154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.517439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.517717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.525814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2a067-ac0d-4255-a937-3f89dac932e4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.529008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.530541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:07.549263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:07.551489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:07.554468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:07.554468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:07.554468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.554468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:07.554468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 295/589] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:07.561262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.561770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.562488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.562768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.563043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.563836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.564148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.565601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.577660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 295/590] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.578294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.664474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1b833-1aa5-4a8e-9a53-b83261e2e7ab None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.681366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8627db-914c-4dc9-9f9d-9498ea3b4e66 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.702215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.702896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.703187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.703436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.704280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.704589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.706079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.722286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.722286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.722286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.722286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.723044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:07.723044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.723044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.730147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 296/591] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.731037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.734934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 296/592] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:07.735782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.841032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141133a1-ff09-42f7-82b2-7618bb749144 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.841792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9326b-d76a-4f63-8133-0fe39b08d5fe None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:07.876724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.877101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:07.877561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.877758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:07.877921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.878072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:07.878218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.878361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:07.886780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.888292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.890728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:07.892189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:07.903523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:07.905901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:07.908191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:07.912723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 297/593] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:07.912723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:07.912995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:07.914975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 297/594] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:07.917089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.013163 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118ce8e-ac48-4fe6-863a-a384ca07c0b8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.015926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd044e-eab7-442a-a114-b5aba8dba09f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.047833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.048631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.049014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.049415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.050262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:08.050666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.051209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.052004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.052179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.052932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.053161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.060290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.061792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.074628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 298/595] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:08.076018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:08.081686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:08.084402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 298/596] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:08.086926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.190426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388d855-d437-49c7-b7cd-9cf9716c7da6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.196652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a68999-46bb-4928-8c7a-c41998671e7c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.234527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.235525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.235809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.236178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.236691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.237545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.237830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.238105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.238833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:08.239141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.240515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.248248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.249805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.252486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 299/597] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:08.253344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:08.273958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:08.276004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:08.278178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:08.278178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:08.278178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:08.278178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:08.285062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 299/598] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:08.285062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.353762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0024562-cc47-47ba-a85b-cf648dd4162a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.387527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.388204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.388486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.388760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.389595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:08.389903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.391383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.402314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c5af9-1d15-4ed1-8598-85e4ca867e0f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.405150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 300/599] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:08.405882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.438099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.439398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.439685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.439964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.448886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.450383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:08.468104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:08.470108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 300/600] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:08.471797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.533515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba1fb6-a416-43cf-9b7e-4d9944b93d90 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.571687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.572876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.573484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.574026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.575379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:08.575987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.578723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.584577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadb6c-869d-4fb3-9475-cf8f6067ba0f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.594046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 301/601] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:08.594973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.628551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.629754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.630870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.631150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/752019a13ba44236ba1c1e13aea6129d/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.649915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=752019a13ba44236ba1c1e13aea6129d, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.651688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.700823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7443e0-86c0-4b5f-971c-ca5c676ca8b7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.729262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 301/602] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:08 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/752019a13ba44236ba1c1e13aea6129d/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:08.730962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.740265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.742051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.743220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.743220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.748610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:08.748954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.750510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.779176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 302/603] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:08.784161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:08.933868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c7879-5c6a-4f75-9832-ea4112353a26 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.955451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be76e9e-4c22-4074-9ae8-79066c49a1ad None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:08.970507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.971314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.971598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.971874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:08.979731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:08.981228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:08.995786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:08.996727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:08.997667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:08.998089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:08.998089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:08.998089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:08.998313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 302/604] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:08.998389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/eee618b771c149d98b108e389c511acf/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.003773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:09.018490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=eee618b771c149d98b108e389c511acf, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:09.020652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:09.113491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cc482-7d1d-46d9-9fde-8a5f40a44704 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:09.128403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 303/605] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:08 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/eee618b771c149d98b108e389c511acf/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:39:09.152230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:09.152944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.153260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.153536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.154389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:09.154811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:09.156435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c24c7d-f09d-4c1a-9ec0-c2ed0b32a6ed None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:09.175318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 303/606] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:09.182471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:09.333311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173af493-297a-4591-af38-66f7c501fb72 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:09.386481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:09.387392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.387672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.387946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9a8e3bf8abe544a98ba074737674ab93/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.410786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=9a8e3bf8abe544a98ba074737674ab93, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:09.413268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:09.476982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68f55-59ca-465d-8a7f-8923aeb5ded3 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.477350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68f55-59ca-465d-8a7f-8923aeb5ded3 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.477649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68f55-59ca-465d-8a7f-8923aeb5ded3 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.479584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 304/607] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:09.485303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd58f-e57b-4a40-bbb7-b65a9f869777 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.485640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd58f-e57b-4a40-bbb7-b65a9f869777 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.485916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd58f-e57b-4a40-bbb7-b65a9f869777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.503544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 304/608] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:09 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9a8e3bf8abe544a98ba074737674ab93/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:09.510859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8acbd58f-e57b-4a40-bbb7-b65a9f869777 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:09.512284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8acbd58f-e57b-4a40-bbb7-b65a9f869777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:09.586282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 305/609] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:39:09.610833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:09.644120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd499-9d9d-4213-8b66-7b4511e18c7a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.644451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd499-9d9d-4213-8b66-7b4511e18c7a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.644855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bd499-9d9d-4213-8b66-7b4511e18c7a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.648243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 306/610] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:09.666567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.666903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.667129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.689033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:09.692091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:09.789099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc19723-780e-4abf-b164-88394a1c6c84 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:09.828973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 307/611] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:09.829874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:09.830841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:09.831264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:09.831719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:09.844291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:09.852644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:09.853739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:09.854565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:09.855183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:09.855266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 305/612] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:09.866379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:09.954926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b358b2-7930-4fc1-9340-ed84dca84723 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.003025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.003727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.004010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.004286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.025437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:10.026799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d30938-9d9f-4e77-b871-1407c910c94d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:10.041698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:10.043803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:10.044638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 308/613] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:10.048358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.066857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.068412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.068935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.069443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.070403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:10.070913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.072490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.082450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 306/614] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:10.088719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.240074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab1e29-0124-4ba6-aed8-5ae3dba1b3e8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.278902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.280086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.280597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.281119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.288091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de986-fa0a-4843-af90-49675f85cee2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.294175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.296651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:10.315991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:10.316905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:10.317849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:10.317849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:10.317849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:10.317849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:10.320113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 307/615] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:10.334813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.359088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.359856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.360059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.360303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.361057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:10.361477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.363092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.376318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 309/616] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:10.377559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.438554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b035-9ea2-491f-a0b5-77b9351cdf15 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.494852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.495450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.495744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.496022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.496755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:10.497112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.498488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.523526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 308/617] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:10.535325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.549255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e0f8-8d0f-426c-9420-dcbd4f1ad44b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.574276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.575179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.575461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.575733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.588422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.590031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:10.608280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:10.609216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:10.610083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:10.610083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:10.610083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:10.610083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:10.614143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 310/618] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:10.616039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.757576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b34be-041e-4b51-8edd-1b982ce4458f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.761834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4556a92-3c24-4015-a376-6496402aee7e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.807696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.808361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.808640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.808909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.813062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:10.813062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.813062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.828178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 311/619] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:10.829677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.832779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.834497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.834985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.835448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.854145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.855913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:10.894397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:10.895394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:10.896846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:10.901437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 309/620] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:10.914949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:10.946802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daa133-9f6d-4ca0-84ea-b1b4486820cb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:10.983710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:10.984569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:10.984854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:10.985153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:10.993816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:10.995268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:11.013077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:11.014015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:11.014926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:11.019301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 312/621] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:11.020550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.132943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b262e-0af1-46d5-8a31-b53249d09028 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.172553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.173258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.173540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.173709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b63ff0-e392-4611-a040-50066e32ec42 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.173876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.174634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:11.174939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.177966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.202919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 313/622] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:11.204810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.258511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.259210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.259494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.260041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.260907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:11.261249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.262798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.281530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 310/623] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:39:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:11.299401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.328930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dc570-d1dc-490a-a353-e4be5698b8c7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.368039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.368840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.369314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.369591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.386505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.388061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:11.408543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:11.410568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:11.413317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:11.413317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:11.413317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:11.413317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:11.417292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 314/624] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:11.418474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.498444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8b148-98b2-4918-987c-aaa2be5fd5dd None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.541297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.541297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.541297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.541297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.541695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4f99-d2ed-4052-9d8c-663b8fa08f39 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.582170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.582959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.588126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.588126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.588126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:11.588126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.588126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246c92b-2d07-4f87-a2ea-1b817f97bbf1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.605152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 315/625] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:11.606958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4609b-272e-4589-b50c-b61e4112f1bd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.607383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4609b-272e-4589-b50c-b61e4112f1bd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.607797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4609b-272e-4589-b50c-b61e4112f1bd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.609927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 316/626] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:11.614282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4609b-272e-4589-b50c-b61e4112f1bd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.615946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.617591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514f6d4-001a-4f7f-8d5f-8309a662f5d7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.735473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 311/627] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:11.735473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a9a2-e959-4721-81c7-b445503464cc None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.735473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a9a2-e959-4721-81c7-b445503464cc None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.735473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a9a2-e959-4721-81c7-b445503464cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.744842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4609b-272e-4589-b50c-b61e4112f1bd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.756599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e843a9a2-e959-4721-81c7-b445503464cc None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:11.758493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e843a9a2-e959-4721-81c7-b445503464cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:11.780904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.782053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.782167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.782446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.790422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.791963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:11.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:11.807617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:11.808670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:11.812524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 317/628] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:11.813477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.837171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 312/629] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:11.839706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c31d-513a-4455-8590-782cd52aa7a8 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.839997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c31d-513a-4455-8590-782cd52aa7a8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.840325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65c31d-513a-4455-8590-782cd52aa7a8 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.845851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 313/630] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:11.846616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65c31d-513a-4455-8590-782cd52aa7a8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:11.918379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2dcc6-ac41-4da5-bde7-33c927f52173 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.952240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.953054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.953349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.953625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.953901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65c31d-513a-4455-8590-782cd52aa7a8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:11.963579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.965018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e36ddfe1-e22a-4b31-9c4f-d3edf430893b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:11.982773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:11.983687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:11.984575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:11.984575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:11.984575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:11.984575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:11.984575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 318/631] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:11.985362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.985465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.985729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.993308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:11.993979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:11.994261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:11.994535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:11.995319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:11.995621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:11.997096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.002471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:12.003663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:12.009277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 314/632] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:12.010352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.085164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 319/633] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:12.085164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.130824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2128-0c6d-4c86-898a-23dc7b21ea44 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.165307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.166413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.166889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.167338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.176771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e0f84-0cfa-4c7b-a621-d884114e6ed9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.178046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:12.186043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:12.187031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:12.188147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:12.190549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 315/634] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:12.191380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.220058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.220730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.221016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.221323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.222044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:12.222352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.223732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.235197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 320/635] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:12.236031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.300843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22646d-b722-4efd-8c82-314e4657cdae None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.332672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.334308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.334646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.334923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/4584309e6ee74080b5b3bc63eacdab4c/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.336524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c1746-d342-41d5-b20e-dff24a14b78d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.348480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=4584309e6ee74080b5b3bc63eacdab4c, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.350796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.368514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.374479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.374479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.374479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.379514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:12.387598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:12.388704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:12.389705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 321/636] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:12.390383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.442530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 316/637] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:12 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/4584309e6ee74080b5b3bc63eacdab4c/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:12.443529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.498400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14ddee-fa2d-4861-9c31-55e5829d9cf6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.534949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.540730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20850b-7444-4fdc-a95d-d27dc927577e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.554321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 322/638] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:12.554510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb03e-d736-4a32-9769-82ca2b42d236 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.554920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d3ec-730c-4539-8309-e448f1e60f0c None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.554920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d3ec-730c-4539-8309-e448f1e60f0c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.554920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5d3ec-730c-4539-8309-e448f1e60f0c None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.554920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 323/639] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:12.554920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d3ec-730c-4539-8309-e448f1e60f0c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.584650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.585501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.585781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.586049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.593669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.595048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:12.610361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:12.611314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:12.612307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 317/640] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:12.613364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.666545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5d3ec-730c-4539-8309-e448f1e60f0c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.700195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.700873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.701194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.701489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.702217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:12.702530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.703898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e56d-cee7-4b80-9437-16811d7e1862 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.713269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 324/641] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:12.714706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.714706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.714706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.726678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83971-81f8-4c77-be88-f65d7ff75b15 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.731241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:12.732440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:12.761064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.762102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.762442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.762736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.773905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.775364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:12.793054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:12.794119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:12.794997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:12.794997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:12.794997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:12.794997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:12.798704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 318/642] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:12.799507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.813319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 325/643] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:12.813319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.907471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c09d-1b83-43ed-b0c7-cc5ad0201c80 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.913928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d16a7-265e-4b06-9855-2d08424b2d2f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:12.941895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.942558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.942872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.943344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.943990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:12.944279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.945782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.948095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:12.948929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:12.949240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:12.949527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:12.963231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 319/644] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:12.963231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:12.964830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:12.966350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:12.985224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:12.986154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:12.987122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:12.987122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:12.987122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:12.987122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:12.987122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 326/645] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:12.987406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.066303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6df081-d1b4-4a97-8a8e-8c78bd46510a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.084930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d99b3-83d9-43d4-a8e3-d6534e7e6aed None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.102273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.102933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.103216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.103492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.104205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.104511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.105904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.117013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 320/646] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.118358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.119164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.119451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.119725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.121981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.130128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:13.138173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:13.139327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:13.140362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:13.143978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 327/647] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:13.144764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.236994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529ddf-4d08-4fef-a160-c589397915fc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.243508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691660f-91a7-4fef-af83-07b72ae713f6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.276698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.277634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.278089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.278480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.278673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.279133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.279422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.279704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.280025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.280479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.280589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.280835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.282264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.282382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.297072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 321/648] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.297072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.297356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 328/649] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.297356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.410838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c070a-7394-4e2a-be02-03edf0608559 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.416578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817080ca-ef2d-48f1-8dc6-efd37fd3943d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.450852 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.451999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.452435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.452790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.452912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.453629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.453916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.454095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.454196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.454574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.456094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.463567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.465063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.466943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 329/650] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.467896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:13.485357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:13.486373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:13.487377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 322/651] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:13.487991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.584507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce90e8-5c0e-4972-a485-90ded4970b98 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.594189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727b68-6b0b-4737-8f83-53c51c9d92e5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.620552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.621402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.621685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.621965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.630671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.631350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.632154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.632365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.632479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.632765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.644729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.646861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:13.648380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:13.649416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 330/652] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:13.650981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:13.665393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:13.667469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 323/653] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:13.669914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.751784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad552-3e24-4d39-b841-e9f2d0166062 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.778399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bf453-efb6-4723-a9c2-8c794a8021d0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.787361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.788140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.788696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.789620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.789936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.791386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.810071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 331/654] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.810909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.819207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.819900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.820185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.820459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.821340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.821649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.823539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.846095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 324/655] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.847237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:13.931777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351db8c6-57b9-4fcb-be29-c762c9537db6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.968909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f3d04-bcfd-4753-b9a8-d745ad9d5dd6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:13.973475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:13.974809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:13.975090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:13.975428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:13.976075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:13.976383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:13.979812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:13.991644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 332/656] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:13.992478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.012620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.013331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.013687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.014165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.094902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.096536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.112206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9580b-3b9b-4718-afa6-8bf47e6d4965 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.146672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.147330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.147614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.147892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.202458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 325/657] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:14.203497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.218433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.219914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.321995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea32759-8bc9-464b-aff2-cade40d71996 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.326833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 333/658] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:14.327678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.357072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.358136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.358485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.358825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.366558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.368129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:14.383433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:14.385570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 12:39:14.387793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:14.393203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 326/659] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:14.393203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.428685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b949f4-7cf7-429f-b720-ca0695a014e7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.463230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.464030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.464312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.464584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.475621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.477101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:14.495322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:14.496411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:14.497386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:14.497386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:14.497386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:14.497386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:14.501077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 334/660] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:14.501917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.515569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270c1c-a06a-4988-8bc4-0dfe322bcad5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.550057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.551138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.551582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.552179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.564022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.565795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:14.586428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:14.587641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:14.588636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:14.588636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:14.588636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:14.588636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:14.590489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 327/661] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:14.591495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.608544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c11b7a-b178-4a3d-8b65-6c3f84b7cb11 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.646129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.646814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.647169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.647532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.648457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:14.648844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.650447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.675602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 335/662] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:14.676701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.708098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa78ff-6b2e-41db-af7c-a7c45c1bef78 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.745823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.746733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.747164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.747620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.748519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:14.749029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.750588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.764256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 328/663] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:14.765560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.784186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386a50-5b9d-4c92-89f8-6399cf79cd86 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.819602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.820078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.820360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.820641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.821396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:14.821704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.823064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.835031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 336/664] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:14.835854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:14.872505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ac033-d000-441f-8c7d-2369b70d9503 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.904688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.905372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.905650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.905922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.934179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b74e0-81c3-461f-be2b-27e866abe24d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:14.966376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:14.967178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:14.967462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:14.967740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:14.970068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.971517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e0b7b-fba5-4b9a-8944-a6aae8278096 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.974940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:14.976543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:14.991199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:14.992093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 337/665] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:14.997724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.081059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 329/666] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:15.082388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252970a-7af3-401e-881e-34d71c1b7832 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.082671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252970a-7af3-401e-881e-34d71c1b7832 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.082943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252970a-7af3-401e-881e-34d71c1b7832 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.089198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 330/667] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:15.090300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252970a-7af3-401e-881e-34d71c1b7832 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.098425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3396-8252-47e7-b8fa-b094ed0306af None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.132470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.133227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.133513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.133788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.140611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.142110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:15.155853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:15.156771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:15.157779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 338/668] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:15.158257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.195903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252970a-7af3-401e-881e-34d71c1b7832 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.229303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.229965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.230247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.230525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.231308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.231619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.233200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e040cb-787a-448a-a907-cc4e5a039d41 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.249925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 331/669] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:15.249925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118591c-79c7-480e-b031-3093818042a8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.249925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118591c-79c7-480e-b031-3093818042a8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.249925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118591c-79c7-480e-b031-3093818042a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.264039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38e1-d29e-41e3-bbee-82e8533dccb8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.266428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9118591c-79c7-480e-b031-3093818042a8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:15.267603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9118591c-79c7-480e-b031-3093818042a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:15.297322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.298121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.298409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.298682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.310397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.311851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:15.329947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:15.331048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 339/670] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:15.331986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.345598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 332/671] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:15.345598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118591c-79c7-480e-b031-3093818042a8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.437236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c89bee-5c17-4b67-9163-c27c8af184f0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.449968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118591c-79c7-480e-b031-3093818042a8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.470734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.471398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.471677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.471949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.472733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.473056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.474654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.491451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 340/672] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:15.491451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.493212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.493948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.494235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.494510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.495333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=752019a13ba44236ba1c1e13aea6129d) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.495645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.497103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.503315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 333/673] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/role_assignments?user.id=752019a13ba44236ba1c1e13aea6129d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:15.507042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.603342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598fafa-e994-4f73-ba83-8aac853150c3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.627436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d99a-902c-4313-8677-fa29723da027 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.642370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.643217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.643607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.644125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.644838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.645709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.646887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.664855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 341/674] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:15.666039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.669270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.670303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.670799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.671272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.684285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:15.693945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:15.694852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:15.695674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:15.698453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 334/675] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:15.699537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.783136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240fd66-1bca-4dfe-a464-8455433b9350 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.801473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86b0b6-8de3-4baf-ad44-d530c3c47171 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.818317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.819021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.819303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.819577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.820397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=eee618b771c149d98b108e389c511acf) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.820704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.822173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.828261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 342/676] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/role_assignments?user.id=eee618b771c149d98b108e389c511acf&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:15.828958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.842565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.844088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.844625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.845324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.856277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.859124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-ad0eb724-47ce-4eb8-8f0a-71039176cad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:15.879509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:15.880522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:15.881434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:15.887658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 335/677] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:15.887658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94844b-b90e-419d-a0f1-99542918d39f None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.887658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94844b-b90e-419d-a0f1-99542918d39f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.887658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94844b-b90e-419d-a0f1-99542918d39f None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.889144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 336/678] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:15.890397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94844b-b90e-419d-a0f1-99542918d39f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:15.953275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dbe1d-6876-4b52-8dd1-87d8b77f570d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:15.995337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:15.996058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:15.996337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:15.996610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:15.997422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:15.997789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:15.999724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6f100-9370-4d7d-b361-f00c1a75e187 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.008928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 343/679] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:16.010674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.010967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.011238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.029770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94844b-b90e-419d-a0f1-99542918d39f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.031873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:16.033841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:16.074120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.075031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.075467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.075744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.076527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:16.076833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.078536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.095802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 337/680] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:16.100496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.125719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 344/681] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:16.126960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.237770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4d984-9036-4a38-a103-a1692b148910 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.272374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b2bd-1fae-4e5e-a95d-bb1ee944ad83 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.287851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.288899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.289381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.289839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.291380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9a8e3bf8abe544a98ba074737674ab93) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:16.292165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.294547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.305994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 345/682] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/role_assignments?user.id=9a8e3bf8abe544a98ba074737674ab93&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:16.307398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.320032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.321133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.321569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.321981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.336774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.338708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:16.359819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:16.360909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:16.362016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:16.362016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:16.362016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:16.362016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:16.364248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 338/683] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:16.378410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.490390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b34af0-acbe-42d2-a66a-d8c826d003c7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.526068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.527138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.527564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.527973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.539997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:16.548029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:16.549138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:16.550059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:16.552596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 346/684] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:16.572855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.597422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01754-6acf-4b6c-9b54-c8bb7a4494b5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.657519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.658543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.658995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.659440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.660652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:16.661702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.664182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.685365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 339/685] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:16.692149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.769988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ae46-0057-4274-8ba9-6026876442e8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.819892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.820666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.821032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.821380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.822350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:16.822557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.823989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.825573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfc953-9b0b-4ac7-bbc3-2fd96d0fdb19 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:16.838019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 347/686] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:16.839342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:16.861203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:16.862249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:16.862716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:16.863195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:16.872002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:16.873792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:16.890106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:16.891095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:16.892035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:16.894362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 340/687] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:16.901199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.000903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a18bf4-70ad-4c27-8d78-7da36f193eab None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.014776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48b71-cfc3-460c-b127-24e4b60bf104 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.058345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.059278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.059707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.060845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.061861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:17.063682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.067293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.084858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.085899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.086328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.086742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.104810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 341/688] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:17.106954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.108565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.109647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:17.143119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:17.144232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:17.145340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:17.145340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:17.145340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:17.145340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:17.147712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 348/689] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:17.152705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.268857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e34749-ad28-4d1e-89d7-f04cd3dc6f2b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.322794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12f0a8-3518-4d57-baa7-5ec1c659b621 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.351742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.352402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.352682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.352952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.364130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.364945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.365261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.365539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.366258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:17.366565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.367932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.380822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 349/690] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:17.386338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.436548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.438076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.514081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4a6e-917c-4de9-a429-29117108afcd None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.547957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.548754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.549052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.549326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.556695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.558177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:17.574861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:17.575823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:17.576760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 350/691] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:17.581643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.590131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 342/692] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:17.595155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.731440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f0dfe-1a04-4f00-a020-40cf962b5b61 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.744017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382569-d3da-4848-9527-b9227a4d7323 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:17.792204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.792996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.793312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.793583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.805505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.806947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.818779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:17.819465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:17.819752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:17.820027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:17.820870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:17.821221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:17.822656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:17.825191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:17.826431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:17.827315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:17.827315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:17.827315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:17.827315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:17.827526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 343/693] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:17.835003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:17.854593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 351/694] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:17.857911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.021119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bd-95cf-4204-a511-e1ef0c5d4b32 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.033870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd6f6-aadb-4f8a-b9b6-8eb406427010 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.084752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.084752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.085276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.085432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.089064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:18.089064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.089064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.089572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.089572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.089572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.090029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.113887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 344/695] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:18.119245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.161682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.163323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7d4e-2e0c-4351-aa08-4214554f9e56 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.246446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709bc16-b353-401a-ae66-d09ac74df8ac None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.263263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 352/696] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:18.264620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f999-b7a0-4b6d-b6d9-e0557e26d254 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.264900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f999-b7a0-4b6d-b6d9-e0557e26d254 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.269561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1f999-b7a0-4b6d-b6d9-e0557e26d254 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.271386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 353/697] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:18.272152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f999-b7a0-4b6d-b6d9-e0557e26d254 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.281552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.282346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.282629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.282905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.290614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.292080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-1d36c58c-8039-4bb2-8846-cac5f60e758e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:18.306525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:18.308565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:18.310757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 345/698] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:18.321067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.321067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.321067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.334724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:18.336150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:18.380944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1f999-b7a0-4b6d-b6d9-e0557e26d254 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.407205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 346/699] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:18.408060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.416680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.417506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.417786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.418053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.428954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.430449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:18.448391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:18.450468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 354/700] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:18.452568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.507172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2700da6-b956-46d9-a69a-6d86a0f27a14 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.541628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.542288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.542571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.542851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.543638 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:18.543947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.545426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.554080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a213-8117-4d2d-9a17-56e5f4d029e5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.556619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 347/701] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:18.557439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.592854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.593597 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.593882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.594154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.604354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.605832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-64debfee-68ac-43ef-9008-01b3ff231297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:18.623437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:18.624367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 355/702] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:18.625924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306365-fa1f-4797-8b97-68d526324cdc None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.626297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306365-fa1f-4797-8b97-68d526324cdc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.626367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306365-fa1f-4797-8b97-68d526324cdc None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.632844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 356/703] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:18.632844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306365-fa1f-4797-8b97-68d526324cdc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.663058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f088c-4701-45df-8ca8-8c4f89475f4c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.700194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.700910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.701235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.701564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.702283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:18.702592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.704026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.718120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 348/704] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:18.719262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.743314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306365-fa1f-4797-8b97-68d526324cdc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.778479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.779424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.779952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.780440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.781301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=4584309e6ee74080b5b3bc63eacdab4c) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:18.781620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.783162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57d5a2-a31c-410a-bafb-6bdc1e63d0f7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.797074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 357/705] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/role_assignments?user.id=4584309e6ee74080b5b3bc63eacdab4c&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:18.797074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.797074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.797074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.821171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:18.822454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:18.822700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fae3f-0e6c-4441-92d2-7b77c445c5fa None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:18.865527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:18.866141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:18.866446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:18.866645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:18.867373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:18.867673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:18.869188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:18.883312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 349/706] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:18.884186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.929532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 358/707] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:18.930823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:18.998663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c994e25-3f1c-4330-91e8-58328038c931 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.045879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.046967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.047282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.047561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.056317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.057951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.065795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3fb8-537f-40e2-9711-3f325c631660 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:19.075833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:19.076729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:19.077678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.078681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 350/708] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:19.078681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.119901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.120964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.121617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.122088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.123018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.124864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.189961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b666132-29c2-4b02-a4e4-bf7d49ee45a3 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.210414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 359/709] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:39:18 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:19.211918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.265392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.266686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.268545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.269560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.272940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4961d4b0-cb42-451d-89a5-e161588485f5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:19.305158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:19.306159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:19.306974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.314077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 351/710] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:19.314077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc370f1-e85a-419b-8a33-812411e7d8b4 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.314077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc370f1-e85a-419b-8a33-812411e7d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.314077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc370f1-e85a-419b-8a33-812411e7d8b4 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.314077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 352/711] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:19.318743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc370f1-e85a-419b-8a33-812411e7d8b4 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.396744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf9fa-89b2-45d4-a071-1f83d7df4e3e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.438628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.439304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.439590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.439850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.440636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:19.440955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.442583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66c19a-6b83-468f-8a5f-a08d76b41f0d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.444358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc370f1-e85a-419b-8a33-812411e7d8b4 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.458173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 360/712] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:19.459680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.464642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.464951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.480685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.481447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.481729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.482004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.482333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:19.482767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:19.483129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.483509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:19.484578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.489925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 353/713] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:19.490762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.562434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 361/714] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:19.563437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.591790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e28b60-4f24-474a-8cf2-5759aef40aa0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.628061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.628812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.629127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.629408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.630279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:19.630591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.632729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.640303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 354/715] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:19.645793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:19.696397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0b28f-627c-435c-a5bd-2a9013987ef2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.765761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.766454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.766741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.767019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.767740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:19.768049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.770288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.781073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 362/716] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:19.823587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78062600-9ec6-4b31-a8a8-29405dea5063 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:19.863159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:19.863970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:19.864884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:19.865374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] PATH_INFO: `/v3/services/network` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:19.866048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:19.867457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:19.879974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:19.882471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:19.883506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 355/717] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:19.890438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:20.013840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25080-2001-4d80-8572-a0d7184a0cbd None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:20.059829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:20.060525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:20.060811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:20.061112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:20.061841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] RBAC: Adding query filter params (name=network) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:20.062151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:20.063628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcffb1c-4e31-4fe4-b07c-9a19d6c9ad1f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:20.070884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 363/718] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:20.075917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:20.201725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d8f89-59f5-4655-9191-e131eb19fa91 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:20.251390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:20.252062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:20.252350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:20.252626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:20.253368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] RBAC: Adding query filter params (type=network) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:20.253678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:20.255765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0681a7-7689-422b-b650-6162303f2d18 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:20.263602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 356/719] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:21.403515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1906f-797c-4e65-8907-fad05245cb24 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.404242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1906f-797c-4e65-8907-fad05245cb24 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.404242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1906f-797c-4e65-8907-fad05245cb24 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:21.405916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 364/720] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:21.412440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.413108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.413108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:21.430709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:21.431886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:21.525388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 357/721] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:21.548557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1906f-797c-4e65-8907-fad05245cb24 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:21.660251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1906f-797c-4e65-8907-fad05245cb24 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:21.709450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:21.710256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.710536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.710809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:21.729964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:21.737629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:21.740118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:21.742175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 365/722] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:21.745077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:21.865137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ac45-c7f3-4418-8854-2f73ae1a3aef None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:21.898988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:21.899659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.899938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.900209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:21.900949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:21.901280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:21.902654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29515-d8d1-44cc-aa9d-e0570e8325d7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:21.916368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 358/723] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:21.917676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:21.970670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392a9-c83e-41ab-9aca-4df0602cc347 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.970670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392a9-c83e-41ab-9aca-4df0602cc347 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.970670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327392a9-c83e-41ab-9aca-4df0602cc347 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:21.972199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 359/724] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:21.983598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:21.984031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:21.984404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.011409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:22.012621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:22.072802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42acb53-40eb-4cd1-a2a5-51b099abe049 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.099215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 360/725] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 12:39:22.129297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.133757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.134567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.135122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.135396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.157821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.161332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:22.187851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:22.188821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:22.189741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:22.189741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:22.189741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:22.189741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:22.201141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 366/726] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:22.205340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.256801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d57e69-39a9-445a-81fe-5ac04e7edc48 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.335935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.336745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.337028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.337326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.361657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:22.372688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:22.373717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:22.374540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:22.378532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 361/727] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:22.384446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.396589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a433a9-28c3-443c-9d92-7ce37b1c05d4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.430300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.430955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.431239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.431547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.432237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:22.432544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.433941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.446635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 367/728] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:22.451839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.537896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63841627-0e80-4ba5-a8a5-32dbf334a579 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.550864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe719437-fb91-416f-a3b5-e0b8e979a003 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.588353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.589150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.589414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.589533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.589695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.590212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.590504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:22.590607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.590755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.590872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.592299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a900e73-277d-4153-80a5-15a24c15ecd7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.598049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.600269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.603623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 362/729] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:22.605078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653288-7c0b-476b-a89a-7146cab8e756 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.605371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653288-7c0b-476b-a89a-7146cab8e756 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.605654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653288-7c0b-476b-a89a-7146cab8e756 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.607253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 363/730] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:22.613107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.613398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.613677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:22.615771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:22.616646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 368/731] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:22.618167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.638578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:22.640383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:22.727130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c774-6cdf-4c3e-aa54-193cc74d78e7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.734416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 364/732] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:22.735791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.763767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.764876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.765355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.765803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.778183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.780003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:22.799079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:22.800005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:22.800872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:22.800872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:22.800872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:22.800872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:22.803315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 369/733] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:22.804297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.842303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dda33a-2337-4124-ab76-67c4a9f09893 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.876776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.877373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.877659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.877936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.878771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:22.879082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:22.881077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:22.899781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 365/734] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:22.901849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:22.907893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944780f-045c-491c-ae6a-5a7eabcd51eb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:22.941861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:22.943741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.944237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.944701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.954705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-3703710b-4153-4cfa-9daf-a0f9ec3235b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:22.962367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:22.963293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:22.964133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 370/735] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:22.964815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c0a8-b33b-41ae-a00e-c361f4d82ae7 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:22.965583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c0a8-b33b-41ae-a00e-c361f4d82ae7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:22.965583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c0a8-b33b-41ae-a00e-c361f4d82ae7 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:22.966712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 371/736] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:22.967256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c0a8-b33b-41ae-a00e-c361f4d82ae7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.011698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1660076-1cb2-40da-9c89-9444e4428844 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.047776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.048437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.048723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.048998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.049754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:23.050068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.051987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.063016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 366/737] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:23.063823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.074430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c0a8-b33b-41ae-a00e-c361f4d82ae7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.112312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.112965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.113280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.113555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.164165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4ad0-4c8e-4ca7-a1b8-d9e114d8e263 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.179159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.180622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.197000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.197691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.197976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.198252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.198996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:23.199301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.200671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0efef-22c2-462f-b10b-86bdc9cd9cac None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.209753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 367/738] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:23.210965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a46b-9cb4-498e-a76a-9dad21ae0cf6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.211254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a46b-9cb4-498e-a76a-9dad21ae0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.211533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a46b-9cb4-498e-a76a-9dad21ae0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.228931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e8e1a46b-9cb4-498e-a76a-9dad21ae0cf6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:23.230146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e8e1a46b-9cb4-498e-a76a-9dad21ae0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:23.274406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 372/739] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 12:39:23.275176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.292962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 368/740] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:23.294281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f84c-e1ca-4e78-9063-ed028ffa2061 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.294568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f84c-e1ca-4e78-9063-ed028ffa2061 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.294871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f84c-e1ca-4e78-9063-ed028ffa2061 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.296114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 369/741] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:23.296790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f84c-e1ca-4e78-9063-ed028ffa2061 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.383441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ca626-929e-4f81-b526-9cd25f813d51 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.392240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1f84c-e1ca-4e78-9063-ed028ffa2061 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.416242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.417125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.417352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.417620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.424384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.424681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.425491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.425771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.425877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.426041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.436457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.437916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:23.441254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:23.442719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:23.443926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:23.447588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 373/742] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:23.448280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-cec7215e-c38a-4f45-98fb-fe47c04e67c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:23.454950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:23.456011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:23.457469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:23.457469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:23.457469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:23.457469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:23.457469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 370/743] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:23.457894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.457977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.458233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.475115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:23.476277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:23.539849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 371/744] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 12:39:23.539849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.545289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778d9b-c0fd-441d-bd6c-c365fd653196 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.579560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.580360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.580648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.580928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.591739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.593228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:23.610455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:23.611340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:23.612217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:23.612217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:23.612217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:23.612217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:23.612217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 374/745] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:23.612495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.655790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1392f0-2d1f-4986-bb91-41b4c89be42c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.690423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.691368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.691966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.691966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.692890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.694745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.710680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96b7af-3ebd-4343-9048-9b4ebdf456b1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.744062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.744730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.745013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.745316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.746141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:23.746443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.747880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.764508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 375/746] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:23.765310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.775309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 372/747] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:23 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:23.776302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.870073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedba0b9-27c6-4781-8fcf-95e3f43792e8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.909532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a56571-3eb1-4776-a598-aa9bcc3d35cc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:23.912431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.913244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.913598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.913887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.914626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:23.914937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.916364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:23.933494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 376/748] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:23.933494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:23.952172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:23.952852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:23.953171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:23.953450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:23.954179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:23.955602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.043968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f71156-bf17-4823-b6b4-d21c9428cde7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.054790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 373/749] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:23 2022] POST /identity/v3/services => generated 240 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:24.062300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.096092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.096837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.097162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.097693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.099040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:24.099349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.101751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.123529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 377/750] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:24.123529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.192000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78499efe-ae34-443c-a047-f386e50faa67 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.235499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.236378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.236762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.237164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.253653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea87c2d-0f4d-41b6-b335-1dc247813c8f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.295545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.297153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.297595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.298272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] PATH_INFO: `/v3/users/nova` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.311272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.313080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.325149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.326774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:24.330315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:24.331321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:24.332265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:24.339935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 378/751] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:24.341518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.430476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 374/752] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:24.431134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.451037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7273c-1033-4c32-813d-511f7c50546a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.487652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.488757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.489979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.490447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.497743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.499472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:24.514289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:24.515212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:24.516077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:24.523558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 379/753] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:24.524679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.532133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f12db4-a462-428e-be28-6a8f45ff33c6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.566959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.567927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.568168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.568455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.569332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:24.569642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.571104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.633375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 375/754] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:24.634480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.779311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b120a-ecd9-440f-9689-5827e7a71ab1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.816344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.818339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.818836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.819311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.829971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.831653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:24.850375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:24.851298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:24.852179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:24.852179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:24.852179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:24.852179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:24.854473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 380/755] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:24.855554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.863512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc016b9-86f1-4869-aae0-34d0f78b1db9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:24.897335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:24.897999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:24.898284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:24.898561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:24.899413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:24.899648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:24.901119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:24.918675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 376/756] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:24.918675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:24.966210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb9792-6830-441f-a09e-8f502e4e4e1d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.002228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.003278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.003741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.004163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.016601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.018296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.018934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617710f4-253d-42ea-b895-93dc0c64522f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:25.048420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:25.049492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:25.050372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:25.050372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:25.050372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:25.050372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:25.053064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 381/757] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:25.054241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.059738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.060642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.061148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.061600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.062668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:25.063595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.065183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.080892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 377/758] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:25.082128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.167747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690661a4-d3da-4963-89a3-b3f17b24551e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.204983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f081f73-50c2-4ce6-8d9f-9718cad08597 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.209761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.210642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.211176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.211656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.212690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=4584309e6ee74080b5b3bc63eacdab4c) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:25.213604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.215615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.229831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 382/759] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/role_assignments?user.id=4584309e6ee74080b5b3bc63eacdab4c&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:25.230693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.262891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.263570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.263895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.264175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.264904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:25.266140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.268664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.294049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 378/760] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:25.297640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.441136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81206b7d-db1e-4657-943c-991e518814e3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.475324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a23e0-52b6-44cc-9c7a-a5b3e6a56ce7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.486679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.488086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.488576 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.489317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.496637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.498444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:25.514688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:25.515621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:25.516489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:25.516924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.516924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.516924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.516924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.519571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 383/761] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:25.527101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.529265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.532088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:25.558805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:25.559734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:25.560616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:25.566437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 379/762] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:25.574689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.703621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1e27b-4333-41ca-82e8-72bd03e34e0d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.738955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.739993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.740484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.740960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.742016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:25.742605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.744244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.758993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174d9b-8979-4ae7-89cd-b46918df8703 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.762081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 384/763] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:25.774254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.813065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:25.813065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:25.813065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:25.813065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:25.813481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:25.813481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:25.813481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:25.823539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 380/764] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:25.828920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:25.970761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594a2a6-b47c-4616-bda3-b09dab3abe40 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:25.971271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59a96-a13f-4fa8-9559-74804289de41 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:26.017340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.018170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.018449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.018785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.023302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=9bd3d5788bc74f70a942f44f2f38dfca, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.025858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e6c39-33e2-40a3-a728-986e2fff0626 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.037651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.038419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.038708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.038985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.039824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=70f76bd2fb124f4f9ab3d05cc0146e3d) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:26.040188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.041666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e497c-a968-4e7d-9ce6-38ada6b00a69 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.048109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 385/765] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:25 2022] GET /identity/v3/role_assignments?user.id=70f76bd2fb124f4f9ab3d05cc0146e3d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:26.138319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 381/766] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:25 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:39:26.257547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7360b7-683e-4de7-914e-0838018e5d2b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.257898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7360b7-683e-4de7-914e-0838018e5d2b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.258113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7360b7-683e-4de7-914e-0838018e5d2b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.260189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 386/767] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:26.266033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3158a0-2ea1-42a6-a884-3027d6ce03a6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.266332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3158a0-2ea1-42a6-a884-3027d6ce03a6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.266653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3158a0-2ea1-42a6-a884-3027d6ce03a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.285089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5b3158a0-2ea1-42a6-a884-3027d6ce03a6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:26.286792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5b3158a0-2ea1-42a6-a884-3027d6ce03a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:26.369427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 382/768] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:26.397972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7360b7-683e-4de7-914e-0838018e5d2b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:26.426383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe977-8313-4ef9-8494-7c7225ec80d7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.427197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe977-8313-4ef9-8494-7c7225ec80d7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.427536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fe977-8313-4ef9-8494-7c7225ec80d7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.429111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 383/769] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:26.434788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.435070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.435352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.455817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:26.456999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:26.526226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7360b7-683e-4de7-914e-0838018e5d2b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:26.527708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 384/770] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:26.552040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:26.578575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.579775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.580276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.580743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.581673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.583537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:26.597722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:26.598735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:26.599583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:26.602481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 387/771] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:26.609171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:26.713230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb8eab-bb30-4b4e-b7e1-e5be98a8d6da None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:26.761850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.767389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.767676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.767985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] PATH_INFO: `/v3/services/network` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.768616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.770549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:26.787370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:26.788423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:26.789278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 385/772] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:26.797009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:26.846950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ce4b-a405-4609-af20-788e2a24c749 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:26.907374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77756-2201-4567-bc03-ea8a2c01c1bc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:26.937358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.937999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.938284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.938562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.939271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:26.945068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.945068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.946264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 388/773] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:26.950753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:26.951427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:26.951709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:26.951984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:26.952725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] RBAC: Adding query filter params (name=network) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:26.953004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:26.954389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:26.955480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:26.970132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 386/774] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:26.976640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:27.106867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a65794-1003-413c-8f54-911878b7139a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.148555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.149244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.149529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.149802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.150513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] RBAC: Adding query filter params (type=network) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:27.150817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.152181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.157583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 387/775] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:27.163617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:27.165641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac5f4-374a-4a99-8e51-76e75180b087 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.199964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.200648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.200931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.201235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.201998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:27.202306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.203727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.213389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 389/776] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:27.215062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:27.271634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d828554-7982-4e39-bd32-2dc88c16e57d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.319164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.319847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73fb29-09e3-4989-8eaa-533636d4ad11 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.319960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.320153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.320402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.321234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] RBAC: Adding query filter params (interface=public, service_id=dd4ce5fae7064a188fe22e58b2d5e896, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:27.321548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.322929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.331063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 388/777] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:27 2022] GET /identity/v3/endpoints?service_id=dd4ce5fae7064a188fe22e58b2d5e896&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:27.338013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:27.355313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.355990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.356333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.356617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.357531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] RBAC: Adding query filter params (interface=public, service_id=a7132b44d8c14e8f855572f0ffd442bf, region_id=RegionOne) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:27.357792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.359271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.372299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 390/778] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:27 2022] GET /identity/v3/endpoints?service_id=a7132b44d8c14e8f855572f0ffd442bf&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:27.373621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:27.450358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f066b54-fa82-4eb3-a007-28e77e5d60db None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.475426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fbe9f-c7aa-4336-8fdc-7aa76df3fcbc None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:27.495247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.495920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.496206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.496482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.497191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.498563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af21dd-53d8-4d8f-b502-4cff72bb327c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.504247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 389/779] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:27 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:27.511756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:27.512456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:27.512740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:27.513016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:27.513807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:27.515377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa013c4-ed44-4ce2-ba91-3f8ec1ed2f81 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:27.529262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 391/780] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:27 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:28.077404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5269-1c51-4709-8c73-fd493aefbdf3 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:28.078422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5269-1c51-4709-8c73-fd493aefbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:28.078914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5269-1c51-4709-8c73-fd493aefbdf3 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:28.080783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 390/781] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:28.085725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:28.086246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:28.086718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:28.114721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:28.116280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:28.199195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 392/782] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:28.228448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5269-1c51-4709-8c73-fd493aefbdf3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:28.356691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5269-1c51-4709-8c73-fd493aefbdf3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:28.409728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:28.411148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:28.411654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:28.412134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:28.425958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:28.434617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:28.435536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:28.436340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:28.439132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 391/783] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:28.445250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:28.568913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77feaa-8d42-4d14-8f51-e540fbe6f794 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:28.606069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:28.607292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:28.607774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:28.608241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:28.609263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:28.609780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:28.611419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:28.621582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 393/784] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:28.630805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:28.774159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98b62b-1e14-4356-abb6-55a55ce51961 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:28.822991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:28.824172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:28.824694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:28.825185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:28.839416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:28.841138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-9648ba65-ea4a-4760-b9e6-b36759874aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:28.862267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:28.863137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:28.864592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:28.864592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:28.864592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:28.864592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:28.866603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 392/785] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:28.872502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.012079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36addb85-7c3e-44b0-8170-f35469d71fdb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.036875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d983-592b-46c8-b175-750d8bf95e71 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.037212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d983-592b-46c8-b175-750d8bf95e71 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.037473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00d983-592b-46c8-b175-750d8bf95e71 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.039087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 393/786] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:29.044361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e40-71f0-4224-b2db-94b0e232aa79 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.044648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e40-71f0-4224-b2db-94b0e232aa79 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.044921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117e40-71f0-4224-b2db-94b0e232aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.046687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.047360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.047641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.047916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.048640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:29.049056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.050537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.064336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 394/787] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:29.076144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.079200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-45117e40-71f0-4224-b2db-94b0e232aa79 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:29.080377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-45117e40-71f0-4224-b2db-94b0e232aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:29.168470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 394/788] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:29.170582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3e54-9c55-4692-8a04-5dae23c52741 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.170868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3e54-9c55-4692-8a04-5dae23c52741 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.171143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3e54-9c55-4692-8a04-5dae23c52741 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.173365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 395/789] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:29.179017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.179379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.179723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.180953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355c6ad-9866-4120-9d73-707c9bdb3a16 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.200783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:29.202273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:29.221157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.222602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.223806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.224312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.234851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.237216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:29.256397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.257387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:29.258315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:29.261582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 395/790] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.263304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.277651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 396/791] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:29.278799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.364842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f75bf9-4009-4ec6-9ebc-f4dbd83e9181 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.376418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716a2c-b77b-456c-9a3f-9b9ea8469dc9 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.399250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.400180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.400531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.400871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.411637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:29.412502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.413466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.413947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.414395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.415406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:29.415911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.417570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:29.420001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.420887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:29.422023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:29.426264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 396/792] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.427217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.439561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 397/793] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:29.440713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.527707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73152df6-3226-4bb4-8a80-6e0a2c10ce26 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.540167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff674a3-20bb-4b2c-bb4d-d72b3b108e3c None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.561723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.562695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.563349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.563684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.575125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:29.583515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.583515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.583515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.583515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.583839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:29.583839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.583839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:29.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.585254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:29.586345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 397/794] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.587192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.594148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 398/795] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:29.595332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.696953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a282bc1-71ee-4442-b395-203ca973547d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.698567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7741c2b-d9e9-4949-a535-139085ce7aee None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.731395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.732311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.732742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.733187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.734100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:29.734554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.736167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.739529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.740445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.740820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.741218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.747079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 399/796] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:29.748211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.753629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.755675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:29.774814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.775796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.777000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:29.777000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:29.777000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.777000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:29.777000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 398/797] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.778085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.855235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956364b-9a47-4d07-97ee-93fa5a73cb2d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.877698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccf135-f3f5-4fcc-b7a6-87de5b9ea1df None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:29.889928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.890954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.891399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.891816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.904254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.906130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.912890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:29.913774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:29.914149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:29.914455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:29.926638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:29.927109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.928225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.929370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:29.929370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:29.929370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.929370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:29.929590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:29.931447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 400/798] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.932561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:29.952129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:29.953265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:29.954445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:29.954445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:29.954445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:29.954445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:29.954445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 399/799] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:29.954714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.038478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbe8ef-7280-4f80-a989-ec707ffa93bc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.054151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d7af9-1995-4097-938f-1a969190f93e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.073513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.074423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.074853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.075298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.076160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.076609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.078212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.088291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.088964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.089368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.089547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.090269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.090570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.091940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.092853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 401/800] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.094390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.113000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 400/801] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.115470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.215144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628bcbe-dc54-482d-94df-ef7df3ca8acc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.221244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddad04-1253-4a93-8955-50bb86f10e1e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.248513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a845b-f592-4d46-982b-733decd09201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.249194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a845b-f592-4d46-982b-733decd09201 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.249711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a845b-f592-4d46-982b-733decd09201 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.249711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a845b-f592-4d46-982b-733decd09201 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.250469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a845b-f592-4d46-982b-733decd09201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.250743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a845b-f592-4d46-982b-733decd09201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.252200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a845b-f592-4d46-982b-733decd09201 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.254841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.255675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.255955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.256227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.263192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.264643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.266017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 402/802] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.267549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a78-96c3-4f89-bad7-6f17934fc892 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.267834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a78-96c3-4f89-bad7-6f17934fc892 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.268112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c4a78-96c3-4f89-bad7-6f17934fc892 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.269504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 403/803] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:30.272001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c4a78-96c3-4f89-bad7-6f17934fc892 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:30.287314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:30.288222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 401/804] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:30.289542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.375357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c4a78-96c3-4f89-bad7-6f17934fc892 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.384392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0046ecd-01df-4db6-b168-55f366d96a9e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.407918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.408720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.409000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.409299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.416426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.416737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.417241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.417523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.417794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.418199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.424986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.427137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-2cce1dbf-c633-4738-9d16-85fd94fccd89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:30.433724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:30.434728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:30.435648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 404/805] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:30.438871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cc8b-08de-4746-9619-4ef9f8a9b8c2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.438871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cc8b-08de-4746-9619-4ef9f8a9b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.438871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8cc8b-08de-4746-9619-4ef9f8a9b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:30.449069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:30.450308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:30.451644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 402/806] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:30.452311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.461548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-aee8cc8b-08de-4746-9619-4ef9f8a9b8c2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:30.462744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-aee8cc8b-08de-4746-9619-4ef9f8a9b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:30.526629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 405/807] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:30.527706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccff3-ceba-4eb6-9829-d6d8b25c22f7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.527994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccff3-ceba-4eb6-9829-d6d8b25c22f7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.528269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eccff3-ceba-4eb6-9829-d6d8b25c22f7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.529552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 406/808] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:30.530234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eccff3-ceba-4eb6-9829-d6d8b25c22f7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.564456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437c12e-e97e-4cee-b09b-17d925b73457 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.597467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.598950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.599394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.599673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.600451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.600757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.602216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.613816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 403/809] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.614920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.634335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eccff3-ceba-4eb6-9829-d6d8b25c22f7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.667748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.668412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.668691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.668962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.669815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.670122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.671537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bcf5-a85d-4b35-ad32-d64d2b185995 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.687771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 407/810] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.688992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.689308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.689583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.705852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:30.707048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:30.712448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f203f9-a73b-46e6-b6ca-73ea4c09cba6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.744715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.745410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.745690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.745962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.746784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:30.747087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.748509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.765733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 404/811] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:30.766321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.771831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 408/812] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:30.772642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.859410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40c50b-1afb-428c-9e9a-b2359b81955f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.863563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881192-156d-42bc-be25-0f203c91eadc None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:30.891339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.892139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.892415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.892685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.893355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.894709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.896616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:30.897517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:30.897803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:30.898074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/4584309e6ee74080b5b3bc63eacdab4c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:30.900005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=4584309e6ee74080b5b3bc63eacdab4c, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:30.901435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:30.907256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:30.908342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:30.909382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 405/813] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:30.910429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:30.968325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 409/814] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:30 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/4584309e6ee74080b5b3bc63eacdab4c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:30.969430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.014242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674f8fe-3535-4aa0-a96d-9d3629614fcb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.050588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.052129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.052487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.052836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.064331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.066062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.076043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabb803-2f9b-4dcb-a232-4f49f70a1641 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:31.085337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:31.086489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 406/815] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:31.092235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.122395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.122985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.123272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.123553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.193737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ce36-ec9b-49da-aeda-30645f1253b6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.197925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.199448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.229319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.230178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.230471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.230750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] PATH_INFO: `/v3/services/network` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.231401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.232771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:31.244969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:31.246189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:31.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 407/816] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:31.253424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.307406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 410/817] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:31.308262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.350428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31daca8-c747-4232-b617-27e258cd7d70 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.384014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.384969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.385349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.385688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.386458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.386836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.388260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.392987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 408/818] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.393835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.416961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd557f6f-111e-478e-8a3c-329092971635 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.451685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.452349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.452645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.452905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.453659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.453968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.455330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.471966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 411/819] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.472727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.493824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752099-3ff7-4fb8-88cc-bcea65b53dae None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.525916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.526678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.527031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.527371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.528148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.528523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.529995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.534607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 409/820] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.536109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.574924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e7f6d-4491-46cf-b6b9-ce55b33453dc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.607583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.608633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.609105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.609542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.620292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.621781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.634331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05445021-f1fc-498e-b8f2-6d71141c9cd2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:31.639424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:31.640315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 412/821] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:31.641820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.672532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.673238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.673523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.673795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.674495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.674799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.676218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.685665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 410/822] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.685665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.744342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c666-5118-49c4-90c4-2ad2ba760c4e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.777798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.778595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.778905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.779190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.786350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.787798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.788260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4c8a4-33b5-4a09-9343-1f0096919aca None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:31.802048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:31.802960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:31.803840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 413/823] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:31.804310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.824700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.825402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.825685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.825959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.826664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] RBAC: Adding query filter params (type=network) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.826968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.828335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.837818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 411/824] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.837818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.905757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e5fe3-8269-4bb2-a030-f04bdd89609f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.932728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3862-fb80-418f-a8ae-55f001530df8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:31.938386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.939046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.939332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.939611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.940333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:31.940644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.942143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:31.958568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 414/825] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:31.958568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:31.965686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:31.966347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:31.966699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:31.966979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:31.967712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:31.969086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.053719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1847967-fd42-426e-aed7-9524cebe0ffa None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.084884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 412/826] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:32.084884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:32.100680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.101400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.101685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.102132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.103549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:32.103864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.106054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.122375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 415/827] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:32.123259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:32.224988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ccbde-11b8-4f2f-bbf8-833f2ee7980a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.253555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca01a4-7eb9-4b99-a92f-722ef86ccd13 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.263192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.263979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.264324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.264671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.265549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.267018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.291945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.292731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.293017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.293341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.300096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.302177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:32.315878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:32.320341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 416/828] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:32.321279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:32.353289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 413/829] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:32.354277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:32.446835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514abbe-ed49-4171-81e6-1faae44ac352 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.473461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c9abc-c86b-4ea3-a1f0-d1b987c59f53 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.483975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.484815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.485132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.485411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/70f76bd2fb124f4f9ab3d05cc0146e3d/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.510648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=70f76bd2fb124f4f9ab3d05cc0146e3d, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.512094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba52d08-de95-40f4-89eb-17ce70be8121 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.512960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.513782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.514162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.514572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.515471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:32.515887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.517516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.532091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 414/830] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:32.538884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:32.607926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 417/831] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:32 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/70f76bd2fb124f4f9ab3d05cc0146e3d/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:39:32.652198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15aef8-7360-4974-b969-91f1a1dbca86 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:32.688952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:32.689652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:32.689934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:32.690207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:32.691093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:32.691400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:32.693030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d4420-8e79-487c-be9d-0a52020ec551 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:32.700108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 415/832] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:32 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:33.242815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04031-4d0e-4a1d-b45b-d41873cc1816 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:33.242815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04031-4d0e-4a1d-b45b-d41873cc1816 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:33.242815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04031-4d0e-4a1d-b45b-d41873cc1816 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:33.243905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 418/833] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:33.249470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:33.249999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:33.250483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:33.269216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:33.270812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:33.339090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 416/834] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:33.362455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d04031-4d0e-4a1d-b45b-d41873cc1816 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:33.464829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d04031-4d0e-4a1d-b45b-d41873cc1816 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:33.500702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:33.501883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:33.502387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:33.503042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:33.517416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:33.525699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:33.526603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:39:33.527414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:33.530187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 419/835] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:33.536349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:33.638262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50dfe7-be3c-4160-973a-f8b0cf706c6e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:33.672856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:33.674363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:33.674845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:33.675317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:33.676789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:33.677319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:33.678914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:33.687521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 417/836] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:33.694196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:33.804374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969e39-5a43-4898-90c2-ec8ada819040 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:33.837839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:33.838619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:33.838896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:33.839206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:33.851330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:33.852881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:33.871865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:33.872869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:33.873843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:33.873843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:33.873843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:33.873843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:33.873843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 420/837] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:33.880787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:33.985926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdaca8-55e7-4926-83f4-31e0a9278116 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.020383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.021456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.021957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.022459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.023387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:34.023891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.025510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.038997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 418/838] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:34.044684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.147070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa89f20-4542-4309-8515-3cdb630e316b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.181449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.182234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.182511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.182779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.191025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.192861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:34.206740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:34.208245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:34.209289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 421/839] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:34.216009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.318739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb3-c440-486b-b058-eeb76d5c9997 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.353416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.354477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.354974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.355464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.356504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:34.357021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.358719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92a1b2-4235-4e6c-8ee5-de76b98f61af None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.378319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 419/840] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:34.384206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.492908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d365-de6b-475d-9ffe-a539404cfd80 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.529678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.530708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.531195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.531678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.602025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.603928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.679232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938466-569c-4ea3-b809-be13bae26112 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.679797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938466-569c-4ea3-b809-be13bae26112 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.679797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4938466-569c-4ea3-b809-be13bae26112 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.685052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 420/841] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:34.693568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.695510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.696008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.710746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 422/842] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:34.716180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.721454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:34.723022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:34.797263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 421/843] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:34.818077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.838893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca17b26-b3fb-4778-b13e-63fe7b48865a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.884476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.885594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.885879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.886154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.901372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.904569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.927450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83088b-b53d-4b3a-a233-a060ec14e32c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:34.928873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:34.929780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:34.931088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:34.931088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:34.931088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:34.931088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:34.933122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 423/844] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:34.936538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:34.970564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:34.971394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.971675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.971945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:34.972591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:34.974657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-04fedfcb-0ba8-446b-9304-ef24f1e71f81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:34.986273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:34.987329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:34.988150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:34.993070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 422/845] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:34.994410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde33a-e697-4762-a778-2d2404fbae8a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:34.994700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde33a-e697-4762-a778-2d2404fbae8a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:34.994981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcde33a-e697-4762-a778-2d2404fbae8a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.000246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 423/846] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:35.000246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde33a-e697-4762-a778-2d2404fbae8a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.048854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0dc30-59d8-4135-8371-df0adb17f9d6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.086089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.086746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.087026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.087309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.088024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.088331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.089720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0fb76-1a88-4607-b0d6-dad3cf82fd00 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.099780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcde33a-e697-4762-a778-2d2404fbae8a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.100704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 424/847] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.101930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.102219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.102490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.118338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:35.119503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:35.133272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.133937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.134223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.134498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.135458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.135763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.137145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cd9d9-56e4-4431-b223-d7b49dc9caa7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.141565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 424/848] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:35.142659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcc56f-2350-479f-bace-e2cf0961c5df None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.142971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcc56f-2350-479f-bace-e2cf0961c5df None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.143229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcc56f-2350-479f-bace-e2cf0961c5df None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.144469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 425/849] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:35.145375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcc56f-2350-479f-bace-e2cf0961c5df None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.188831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 425/850] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:35.189701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.244725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcc56f-2350-479f-bace-e2cf0961c5df None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.276663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.277500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.277788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.278063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.283365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3138c1-2028-4f68-bf63-045d046dccc8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.284862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.286995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-74c609f9-a864-4948-a365-bdbba7083fa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:35.301497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:35.302497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:35.303364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 426/851] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:35.303933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.304233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.304417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.317929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.318591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.318876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.319150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.319863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.320170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.321603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.322167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:35.323337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:35.325922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 426/852] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.326685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.398009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 427/853] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:35.398949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.450387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a82639-703d-43fb-a615-00d1fa48a3ce None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.486765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.487570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.487854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.488127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.499981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:35.506921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e8f97-298a-48cf-a80b-86576935ea3c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:35.508663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:35.509899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 427/854] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:35.511043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.549894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.550574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.550929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.551283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.552440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.552701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.554214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.570788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 428/855] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.570788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.615436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231a489-7f41-4692-904b-1fd910fe6508 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.650777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.651587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.651871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.652147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.652804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.654216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:35.666880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:35.667815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:35.668625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 428/856] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:35.669477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.671092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253a3fa-7048-44cb-8638-9b93f074ea78 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.705723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.706394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.706676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.706947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.708540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.708839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.710242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.723748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 429/857] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.724612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.776567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073166dd-5e5f-4546-aba9-64d9bd822245 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.809597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.810181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.810462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.810737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.811569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=4584309e6ee74080b5b3bc63eacdab4c) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.811879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.813331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.820448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 429/858] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/role_assignments?user.id=4584309e6ee74080b5b3bc63eacdab4c&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.821305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.827209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d510cf2-67ca-4c72-a14d-721662a21f30 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.874362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.875582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.876025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.876624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.877890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:35.878361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:35.880752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:35.888656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 430/859] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:35.894038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:35.942457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813babcb-dc40-46d9-9a89-44ea46d6c923 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:35.984455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:35.985460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:35.985844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:35.986348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:35.998489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.000128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:36.020073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:36.021104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:36.022028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:36.022028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:36.022028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:36.022028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:36.025193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 430/860] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:36.027175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:36.034843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919e29f-0dff-4078-b57e-f41e8f7f1bf2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:36.082577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:36.083553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:36.083837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:36.084113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:36.085005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:36.085361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.087486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.093966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 431/861] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:36.148034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403754d-03a3-430d-be88-27d475770af7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:36.185816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:36.186493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:36.186773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:36.187037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:36.187762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:36.188065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.189487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.204308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 431/862] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:36.209786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:36.336530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22799a-09e2-48ee-97c1-cc05db66726f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:36.369576 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:36.370387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:36.370665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:36.370933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:36.378535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.380679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:36.395903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:36.396854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:36.398036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 432/863] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:36.404904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:36.510963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94d0-5ec4-40da-9cfc-b8febbea794d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:36.547828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.554566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.576249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 432/864] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:36.577823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:36.714502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df592-0dd6-4bcf-886e-c900b3d73d2e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:36.747958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:36.748626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:36.748912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:36.749224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:36.818416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:36.819887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:36.919847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 433/865] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:36.925518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.027040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbae2d-9bf0-418b-b31d-82cb2ff3f3c1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.063467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.064653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.065197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.065669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.076907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.078612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:37.096498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:37.097429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:37.098742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:37.098742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:37.098742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:37.098742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:37.105149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 433/866] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:37.106682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.211404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f679785-4053-4f35-9dcc-4346db4c0805 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.245823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.246496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.246782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.247058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.247777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:37.248083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.249479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:37.261614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 434/867] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:37.267164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.372635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6028b58-5684-49b9-922e-4eb15c05b646 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.407315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.408442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.408923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.409458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.416827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.418512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:37.433504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:37.434436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:37.435315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:37.442857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 434/868] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:37.444669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.548240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ac2f9-e73a-4f6e-8988-843ddecd7851 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.582484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.583156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.583447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.583727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.584515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:37.584828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.586305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8216-73ee-4e89-be7f-0c5b985e2070 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:37.599542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 435/869] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:37.605612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.636573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9de4d2-2ade-4977-ab7a-41b71b86ab08 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.636769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9de4d2-2ade-4977-ab7a-41b71b86ab08 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.637062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9de4d2-2ade-4977-ab7a-41b71b86ab08 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.638689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 436/870] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:37.643456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.643735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.644013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.661472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:37.662730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:37.722019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f682b5-05a8-43a0-9d9d-0688ccc4b24e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.752886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 437/871] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:37.764633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.765617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.766157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.766634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.767772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=70f76bd2fb124f4f9ab3d05cc0146e3d) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:37.768285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.772009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:37.773187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8232a0e-7049-4102-a81b-1fb7af930a8b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:37.781003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 435/872] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:37 2022] GET /identity/v3/role_assignments?user.id=70f76bd2fb124f4f9ab3d05cc0146e3d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:37.882229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e7feb-d51e-46f3-9f57-1e6029662837 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:37.919728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:37.920335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:37.920621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:37.920899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:37.921657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:37.923061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaeb4d3-eeb0-4dc9-8d35-26025b3b496d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:38.010620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 438/873] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:37 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:38.168561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0e5a-b873-4026-84c6-e79a16a486c2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.168947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0e5a-b873-4026-84c6-e79a16a486c2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.169182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0e5a-b873-4026-84c6-e79a16a486c2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.170912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 436/874] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:38.177411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.177724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.177978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.195629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:38.196831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:38.278803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 439/875] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:38.302622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0e5a-b873-4026-84c6-e79a16a486c2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:38.409207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0e5a-b873-4026-84c6-e79a16a486c2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:38.445250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:38.445989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.446323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.446596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.447290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:38.448718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3681c7c8-32c5-40f7-ab02-faf88e5d9c93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:38.461517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:38.462521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:38.463332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 437/876] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:38.468945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:38.491035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa23e5-9f9e-4844-9434-0390f91337d1 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.491370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa23e5-9f9e-4844-9434-0390f91337d1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.491592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa23e5-9f9e-4844-9434-0390f91337d1 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.493261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 438/877] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:38.498213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.498505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.498783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.516096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:38.517325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:38.595385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5159d-265e-41a5-9b7e-3cb4db04a97c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:38.598846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 439/878] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:38.625428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:38.631578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:38.632262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.632545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.632822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.633604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:38.633924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:38.636038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:38.642707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 440/879] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:38.650122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:38.746129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853f644-7b93-4cad-b29c-68cb7ad88643 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:38.765815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad7e5-f265-4454-b074-0fcc7a47854a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:38.781969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:38.782634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.782955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.783184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.783906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:38.785366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5fa46-ed5e-4df8-b7da-5aa5bffc43db None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:38.803354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:38.804044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:38.804326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:38.809023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:38.809023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:38.809023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:38.809023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d6675-f548-4f65-9d62-19874cca313d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:38.812083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 441/880] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:38.893370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 440/881] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:38 2022] POST /identity/v3/services => generated 269 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:39:40.193362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46202e-f0bb-4a48-9863-1541591d29a0 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.193926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46202e-f0bb-4a48-9863-1541591d29a0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.193926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46202e-f0bb-4a48-9863-1541591d29a0 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.195651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 442/882] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:40.201604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b704-a6cc-4a9c-a53c-1619b4a1b9b1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.202063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b704-a6cc-4a9c-a53c-1619b4a1b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.202139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b704-a6cc-4a9c-a53c-1619b4a1b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.219610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2f85b704-a6cc-4a9c-a53c-1619b4a1b9b1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:40.220783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2f85b704-a6cc-4a9c-a53c-1619b4a1b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:40.297152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 441/883] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:40.317749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46202e-f0bb-4a48-9863-1541591d29a0 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.358444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d183-abe2-44e4-bb67-837aebcf5ed1 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.358745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d183-abe2-44e4-bb67-837aebcf5ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.359012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456d183-abe2-44e4-bb67-837aebcf5ed1 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.360639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 442/884] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:40.366498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.366789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.367068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.383404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:40.384833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:40.423435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46202e-f0bb-4a48-9863-1541591d29a0 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:40.455413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 443/885] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:40.464656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:40.465517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.465805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.466080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.478187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.481806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:40.494756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:40.495683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:40.496539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:40.503400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 443/886] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:40.504996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.580894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43b301-8b90-4bf5-90e8-2f4b2deb9420 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:40.613583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc773c6-9af6-474a-be30-446f21e9d33b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:40.622009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:40.622948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.623301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.623649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.624791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:40.626781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:40.643800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:40.644946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:40.645933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:40.649140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 444/887] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:40.652131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.662415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:40.663145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.663435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.663713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.664538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:40.670502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:40.670502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:40.684255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 444/888] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:40.685942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.787681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24712b3-6616-4761-8c71-60398b9bb9cb None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:40.798240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec198d-b96e-4c42-a144-da1674dc7f9c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:40.822600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:40.823676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.824168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.824642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.825592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:40.826108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:40.827672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:40.832583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:40.833410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:40.833691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:40.833966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:40.835049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 445/889] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:40.840528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.849883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:40.851600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:40.876565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:40.877757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:40.878623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:40.878623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:40.878623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:40.878623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:40.887500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 445/890] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:40.888935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:40.961361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0855787-57fc-4231-84ed-e9aced85aaa4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.001761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.002447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.002732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.003008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.003802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:41.004120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.006253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.017129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 446/891] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:41.019203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.042593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b492b8-ead5-48d4-9085-a40f7d689557 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.094273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.094950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.095237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.095517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.096242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:41.096551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.098761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.111932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 446/892] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:41.118650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.155876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f425a2-c9a6-4d39-a918-1403e0b5efae None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.189671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.190324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.190609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.190886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.192260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] RBAC: Adding query filter params (interface=public, service_id=37891efdfbd14a1aaf51d6860e59abf2, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:41.192574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.193973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44b23-e446-4eb8-85a2-b1b828cafe46 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.198839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 447/893] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/endpoints?service_id=37891efdfbd14a1aaf51d6860e59abf2&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:41.202415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1353f-0194-4f66-bddf-1380c881b045 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.202973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1353f-0194-4f66-bddf-1380c881b045 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.203063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1353f-0194-4f66-bddf-1380c881b045 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.204327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 448/894] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:41.205471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fddd0-a04d-431f-9249-ced72b60f490 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.205817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fddd0-a04d-431f-9249-ced72b60f490 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.206098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fddd0-a04d-431f-9249-ced72b60f490 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.207595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 449/895] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:41.208148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fddd0-a04d-431f-9249-ced72b60f490 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.217216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2de8-52e9-432c-a7f0-27a122104032 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.249678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.250482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.250768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.251046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.258505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.260211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-641fa8a2-7464-487f-91ed-61c8a04eba60 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:41.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:41.275828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:41.276745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:41.277302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 447/896] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:41.278465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.278756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.279035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.295558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:41.296696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:41.304973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fddd0-a04d-431f-9249-ced72b60f490 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.338115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.338775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.339056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.339325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.340000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.341384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eda98-5201-4f36-a73d-24977a670c91 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.346911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 450/897] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/services => generated 1268 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:39:41.348308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.348595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.348878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.365645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:41.366864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:41.368019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 448/898] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:41.368720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.453077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 451/899] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:41.453077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.492700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3906db-2670-4f70-8580-9083c46d908a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.528369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.528874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.529190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.529471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.530330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:41.530641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.532085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.552907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 449/900] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:41.552907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.555368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1964949-f1e5-4014-b309-2d54f20de299 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.590975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.591645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.591930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.592206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.592994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.594459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.652323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2e0a-fe47-4425-a00d-1ebffdc2408f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.661145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 452/901] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:41 2022] POST /identity/v3/services => generated 241 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:41.661987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.709710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.710726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.711014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.711290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.714754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.714754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:41.733442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:41.734456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:41.735322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:41.740434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 450/902] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:41.741470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.818874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab94998-ba3d-423d-9d0f-6437e1956cc9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.857736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d494a-f3f6-4a5e-87f1-8f215048ed73 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:41.861948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.863532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.863981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.864585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.900019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:41.900724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:41.901263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:41.901393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:41.902447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:41.902447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.903666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:41.908616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 451/903] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:41.915127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:41.952896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:41.955127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.021497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542405b-e2dc-40f1-8d6d-71a590095450 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.055545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.056410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.056523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.056762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.057495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:42.057801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.059235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.070100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 452/904] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:42.070933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.086617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 453/905] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:42.096464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.173675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146527fa-64a7-49d7-8d04-3c9ba0ebb227 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.208244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.208917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.209237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.209517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.210311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] RBAC: Adding query filter params (interface=public, service_id=999b7cbacc9e40148f29666b8b4b898b, region_id=RegionOne) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:42.210626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.211426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9c78-45dc-437d-bbb2-73aa45aa4b8a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.212007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.217702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 453/906] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/endpoints?service_id=999b7cbacc9e40148f29666b8b4b898b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:42.225256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.251474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.252394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.252743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.253111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.264614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.266193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:42.283929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:42.285463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:42.287880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:42.287880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:42.287880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:42.287880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:42.287880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 454/907] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:42.300100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.341063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95bc4b-b791-49a0-888e-58f8c45d7ae8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.383100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.384043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.384344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.384887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.385619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.386991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.396929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 454/908] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:39:42.399763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000e569-3b40-4d75-b73d-3d3bccfad16b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.443526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.444848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.445300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.445805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.447220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:42.447782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.449868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.469461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 455/909] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:42.471080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.590222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff616e-368e-4e01-93e4-b32896a699e8 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.624607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.625505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.625776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.626047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.634495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.636495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:42.654956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:42.655888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:42.657229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 455/910] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:42.662589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.769804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d84ed-1584-4fe4-93ac-d59028ec98ad None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.806042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.806823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.807116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.807396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.808264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:42.808693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.811161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35db4b-c161-4498-b3be-de82aa60815d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.825412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 456/911] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:42.832591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:42.942302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17e391-a714-4af3-850d-7f41b91cd8f7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:42.986180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:42.986863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:42.987147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:42.987424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:42.988587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] RBAC: Adding query filter params (role.id=66e439aa1c26473696095d8b84a4d9cc, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=70f76bd2fb124f4f9ab3d05cc0146e3d) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:42.989067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:42.991349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ea7b-08cf-4451-b0a5-5f1d06b14c2a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:42.998822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 456/912] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:42 2022] GET /identity/v3/role_assignments?user.id=70f76bd2fb124f4f9ab3d05cc0146e3d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=66e439aa1c26473696095d8b84a4d9cc => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:43.964911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db21-3ed7-4f13-b9b3-0ae37d81189d None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:43.965692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db21-3ed7-4f13-b9b3-0ae37d81189d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:43.965692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298db21-3ed7-4f13-b9b3-0ae37d81189d None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:43.967128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 457/913] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:43.972501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b5a4-bcba-4862-b659-36f71e05c35b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:43.973159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b5a4-bcba-4862-b659-36f71e05c35b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:43.973255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865b5a4-bcba-4862-b659-36f71e05c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:43.990328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3865b5a4-bcba-4862-b659-36f71e05c35b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:43.991503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3865b5a4-bcba-4862-b659-36f71e05c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:44.058638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 457/914] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:44.080903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298db21-3ed7-4f13-b9b3-0ae37d81189d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.136794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458b09-c60b-48f1-9062-63ebd34221bd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.137097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458b09-c60b-48f1-9062-63ebd34221bd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.137382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7458b09-c60b-48f1-9062-63ebd34221bd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.139011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 458/915] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:44.143927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.144790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.145099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.166187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:44.167460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:44.193657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298db21-3ed7-4f13-b9b3-0ae37d81189d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.229327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.230421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.230887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.231338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.232177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.233756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:44.246383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:44.247347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 12:39:44.248149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.248870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 459/916] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:44.254791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 458/917] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:44.256496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.275836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.360228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33ea99-efda-4350-b19b-8d79f17f2644 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.377520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986823b-349d-456e-946c-3d8c334a8361 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.394816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.395493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.395772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.396046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.396744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:44.397063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.398440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.408001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 460/918] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:44.408991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.421204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.422016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.422298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.422573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.423284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.425006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:44.439660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:44.440654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:44.442034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:44.443505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 459/919] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:44.449095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.543584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d068f8-0021-4595-95b4-efca07f62e35 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.577923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf4566-3128-4fb6-92b2-9d1db5b5e4ef None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.583737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.584413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.584699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.584977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.585768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:44.586077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.587542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.593093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 461/920] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:44.598238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.623930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.625279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.625769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.626406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.627894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:44.628402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.630684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.643057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:44.645645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.736007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcb91c-85d4-4fdb-aea4-14b117427a29 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.765401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4b3b4-9a42-4c69-9eba-53696c3cd9fe None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.781711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.782530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.782909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.783429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.784547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.786639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1374c4-911c-41da-82d0-df2d900caa81 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.802342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.802938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.803223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.803498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.804205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:44.804513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.805917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.810880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 461/922] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:44.817009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:44.868668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 462/923] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:44.897756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357a6-cd91-4c75-ab32-aecd7d4e7e4b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.898434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357a6-cd91-4c75-ab32-aecd7d4e7e4b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.898960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1357a6-cd91-4c75-ab32-aecd7d4e7e4b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.901783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 463/924] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:44.908054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.908667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.909213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.929561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:44.931032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12275587-aaa6-46a9-a925-da66513bc919 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:44.931484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:44.974070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:44.975427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:44.975713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:44.975986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:44.976780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] RBAC: Adding query filter params (interface=public, service_id=e061c0caf0b44073a647753ab1f23585, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:44.977130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:44.978581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:44.984443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 462/925] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/endpoints?service_id=e061c0caf0b44073a647753ab1f23585&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:44.993098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.024882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 464/926] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:45.047337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.110143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278ee3c-eab6-46ae-b26f-948631c6ef6b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.152151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.153098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.153463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.153817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.154906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:45.156799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:45.163749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb97f2d-38a4-44c0-96f6-92d37d8aa43d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.165265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 463/927] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:44 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:39:45.205369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.206460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.207218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.207659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.208524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:45.210120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:45.224426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:45.225665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 12:39:45.226718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:45.233213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 465/928] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 11 12:39:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:45.236249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.350940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda22a3-4cd4-4ea2-bdb4-3ad3622e8acc None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.384392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.385327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.385831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.386345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.387816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:45.387997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:45.389382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:45.397014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 464/929] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:45.403086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.507678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b4c6-7536-4ebf-9ae3-02c3453ade89 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.547875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.550644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.550644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.550644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.550644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:45.550644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:45.552537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0343-ba4a-464d-87ad-ed90b6cd96c5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:45.562035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 466/930] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:45.564287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.665177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311980-5cac-44f3-8c53-adcee1bfd44a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.708223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a337-34e2-462c-befb-09090e62ea34 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.708412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.708538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a337-34e2-462c-befb-09090e62ea34 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.708538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a337-34e2-462c-befb-09090e62ea34 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.708671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.708671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.708671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.708671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:45.708918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 467/931] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:45.709484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:45.714793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.714793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.714793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:45.734729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:45.735912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:45.819216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 468/933] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:45.819765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 465/933] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:45.832577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:45.938439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643b01-2d4c-4d10-8d0a-42caa7f23b3f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:45.985328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:45.986575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:45.987058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:45.987562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.000021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:46.010331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:46.011345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:46.012163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:46.015060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 469/934] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:39:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:46.020939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.138684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38e3e4-a704-4501-a2ca-94b4bd53afbd None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.172628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:46.173326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:46.173612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:46.173942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.174686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:46.175036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:46.176995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:46.185519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 466/935] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:46.192050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.293371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e5344-df49-4d24-a93d-126f901e8828 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.327850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:46.328674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:46.328956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:46.329262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.342021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:46.343497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:46.360795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:46.361716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:46.363685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:46.363685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:46.363685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:46.363685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:46.363685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 470/936] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:46.368688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.473997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aad470-4e18-42ac-b213-5eef89017707 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.508715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:46.509414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:46.509963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:46.510241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.510971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:46.511278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:46.512660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:46.525835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 467/937] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:46.530947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.632117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3d7c8-d361-4d4d-88e7-d30ea5336428 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.666748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:46.667569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:46.667845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:46.668117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.675865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:46.677552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:46.693422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:46.695701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:46.699711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 471/938] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:46.701789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.798384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d59e5-8c5c-470b-a97d-1ac66300bd55 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.837443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:46.838112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:46.838397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:46.838672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:46.839507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:46.839812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:46.841261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:46.858966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 468/939] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:46.864665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:46.965506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f720a3-4158-44da-998a-7a2f4b557c48 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:46.999405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.000199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.000475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.000743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.012147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.013637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:47.032585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:47.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:47.037545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:47.037545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:47.037545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:47.037545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:47.037545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 472/940] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:47.046254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.149909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b16ad-eb72-484f-847b-b71b64528e0e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.184670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.185899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.186397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.186864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.187770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:47.188291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.189870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3a4a-d646-43e4-bf63-129deeee9239 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.202726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 469/941] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:47.213158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.255161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036ab-a24d-4522-a765-be6c010a3d80 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.255471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036ab-a24d-4522-a765-be6c010a3d80 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.255713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99036ab-a24d-4522-a765-be6c010a3d80 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.257404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 470/942] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:47.263129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.263427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.263707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.281321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:47.282563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:47.318242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06d0-341b-4dfc-b6a2-448442643779 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.361187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.362036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.362442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.362789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.364668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 471/943] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:47.378229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.380263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.388582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:47.395261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:47.396125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:47.397419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 473/944] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:47.402185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.488830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8d316-4660-4951-9582-ab57fe023b4f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.504034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57a229-3a86-4bfa-82f6-a1b63ec9354d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.521160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.521823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.522108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.522385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.523082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.524511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.525887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING keystone.server.flask.common [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 12:39:47.536994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.537682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.537959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.544498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.544498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:47.544498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.544498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7a5aa-e0a4-4ee4-8c06-2feb8694eb23 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.552785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 474/945] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:47.554058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa399-d94c-46f1-8165-3551084effa2 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.554346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa399-d94c-46f1-8165-3551084effa2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.554621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa399-d94c-46f1-8165-3551084effa2 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.559847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 475/946] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:47.559847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa399-d94c-46f1-8165-3551084effa2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.587577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.sql.core [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 12:39:47.587577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 12:39:47.587577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [parameters: {'id': '7c1007f750ea415a9b88d96cdf227ad9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 12:39:47.587577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91839) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-5f7dd38d-8be4-4ae6-b2b6-58ebebc49b33 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c1007f750ea415a9b88d96cdf227ad9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c1007f750ea415a9b88d96cdf227ad9. May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application conn.query(q) May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:39:47.604722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result.read() May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 12:39:47.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application next(self.gen) May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application yield resource May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application next(self.gen) May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.session.rollback() May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.force_reraise() May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise self.value May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application session.commit() May 11 12:39:47.606660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._prepare_impl() May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.session.flush() May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._flush(objects) May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application compat.raise_( May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application flush_context.execute() May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 12:39:47.607519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rec.execute(self) May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 12:39:47.608386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application conn.query(q) May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result.read() May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:39:47.609190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [parameters: {'id': '7c1007f750ea415a9b88d96cdf227ad9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.610034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:47.612351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c1007f750ea415a9b88d96cdf227ad9. May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 472/947] 10.222.0.49 () {60 vars in 1140 bytes} [Wed May 11 12:39:47 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.613747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.614803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.630634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:47.632142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:47.670595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa399-d94c-46f1-8165-3551084effa2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.702056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 473/948] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:47.703805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.704695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.704971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.705285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/70f76bd2fb124f4f9ab3d05cc0146e3d/roles/66e439aa1c26473696095d8b84a4d9cc` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.708258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=70f76bd2fb124f4f9ab3d05cc0146e3d, role_id=66e439aa1c26473696095d8b84a4d9cc)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.709740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.710212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.779754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 476/949] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:39:47 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/70f76bd2fb124f4f9ab3d05cc0146e3d/roles/66e439aa1c26473696095d8b84a4d9cc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:39:47.789268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.826203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9bcc4-4e77-41d1-a468-a9da1779a340 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.865241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.866102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.866386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.866656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.874306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.876069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:47.891636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:47.892584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:47.893504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 474/950] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:47.898316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd299ef-f5e6-499b-9fe4-db778121a619 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:47.899580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:47.936062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:47.936796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:47.937105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:47.937383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:47.938053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:47.939477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:47.953267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:47.955601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:47.958159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:47.969087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 477/951] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:47.969087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.018181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485cf5b-fcab-4ef9-981f-d82dea483345 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.054276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.054946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.055235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.055516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.056301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:48.056615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.058171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.067566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bfc2b-6758-4f20-8c03-e957aa67fcbf None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.085279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 475/952] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:48.105924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.106678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.106971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.107247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.108036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:48.108346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.109810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bb607-f552-45cd-97a3-2b372d6b6aba None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.115706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 478/953] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:48.121549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.234143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84918eed-181e-4659-a71e-f33ae0dcd432 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.248285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc90c-4db3-410a-b2bf-33afd1eb12e0 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.248946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc90c-4db3-410a-b2bf-33afd1eb12e0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.248946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfc90c-4db3-410a-b2bf-33afd1eb12e0 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.250586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 479/954] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:48.256972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.257424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.257804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.274510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.275425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.275705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.275975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.276684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:48.276986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.278439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.279209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:48.280934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:48.283827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 476/955] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:48.290147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.361154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 480/956] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:48.384447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.413258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba59fa-4800-451c-adb3-850ec8b10d70 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.455074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.455074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.455074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.455074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.455656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.457740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.508436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8832f2f-dbc5-4283-9ea7-21c5d7217d8c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.545360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.546597 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.547124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.547620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.548543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.551614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.558806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 477/957] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:48.572708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:48.573806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:48.574615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 481/958] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:48.582929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.708659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356e9c-73e1-46de-9425-fa318d4440c2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.746076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.746763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.747054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.747332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.748052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:48.748362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.749773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98cf9d-de6e-4adb-b51a-d61a6c023a62 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.766099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 478/959] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:48.772411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:48.882458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b32e5-aa20-477e-bd52-1252215e7e66 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:48.920529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:48.921235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:48.921514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:48.921784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:48.922485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:48.922790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:48.924154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5dc0-4b64-44b8-aefa-3ab04ac0658c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:48.929652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 482/960] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:50.129834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cb84-9e6e-4096-a9a1-015b2685f9c2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.130350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cb84-9e6e-4096-a9a1-015b2685f9c2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.130428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17cb84-9e6e-4096-a9a1-015b2685f9c2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.132016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 479/961] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:50.137866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.138315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.138492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.155760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:50.156947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:50.226616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 483/962] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:50.249869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17cb84-9e6e-4096-a9a1-015b2685f9c2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.359916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17cb84-9e6e-4096-a9a1-015b2685f9c2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:50.395977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:50.396749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.397034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.397347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.408560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-44e4cbfe-3ae7-4d24-ba33-6f2bb76ba081 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:39:50.417317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:50.418229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.419046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 480/963] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:39:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:50.424819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.508322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb858-575f-48a1-8723-07adba349657 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.508649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb858-575f-48a1-8723-07adba349657 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.508875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb858-575f-48a1-8723-07adba349657 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.511165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 481/964] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:50.517218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.517889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.518376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.536199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcf80-7ff7-4624-a5e3-0d2a80d012bb None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:50.542703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:50.544342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:50.587820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:50.588501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.588788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.589085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.589847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:50.590327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:50.592637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:50.602860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 484/965] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:39:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:50.608421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.640947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 482/966] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:50.664808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.747288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fd13f-dac3-4172-b6ec-6fe02911ee89 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:50.786628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:50.787610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.787998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.788378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.789446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece85b44-8faf-4d0f-bccf-39bffcfcb4a7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:50.800853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:50.802490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:50.820884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:50.822028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:50.823108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:50.823108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:50.823108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:50.823108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:50.825661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 485/967] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:50.829750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.833648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:50.835348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.835719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.836077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.836882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:50.838429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:50.885478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.sql.core [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 12:39:50.885478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 12:39:50.885478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [parameters: {'user_id': '58c038017db34c0a9c13fae8ea593a55', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 12:39:50.885478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91839) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application conn.query(q) May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result.read() May 11 12:39:50.896768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:39:50.897868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application next(self.gen) May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application yield resource May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application next(self.gen) May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.session.rollback() May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.force_reraise() May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise self.value May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application session.commit() May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 12:39:50.899010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._prepare_impl() May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.session.flush() May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._flush(objects) May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application compat.raise_( May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application flush_context.execute() May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rec.execute(self) May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 12:39:50.900158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 12:39:50.901320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result = self._query(query) May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application conn.query(q) May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application result.read() May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 12:39:50.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [parameters: {'user_id': '58c038017db34c0a9c13fae8ea593a55', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:50.903458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 12:39:50.904560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 12:39:50.905772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:50.908719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 483/968] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 11 12:39:50 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:50.915218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:50.954861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af323c94-2522-4201-922b-2a8f0ac65d87 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:50.997277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:50.997960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:50.998241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:50.998511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:50.999242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:50.999551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.000941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1ac52-61b8-4f54-b73b-1fb2d73cc1de None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.017253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 486/969] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:51.017253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796f6e-e2cf-46c5-bb79-d697b1d4ae75 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.017253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796f6e-e2cf-46c5-bb79-d697b1d4ae75 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.017253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4796f6e-e2cf-46c5-bb79-d697b1d4ae75 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.017253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 487/970] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:51.020284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4796f6e-e2cf-46c5-bb79-d697b1d4ae75 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.047659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42381-2215-4bc7-ba8b-f91515b99dd4 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.081828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.082802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.083088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.083365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.091376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.092993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-ce0e6c45-a1a4-4b61-889c-788f757a170c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:51.107699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:51.108648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:51.109700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 484/971] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:39:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:51.110790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509fee-c3bd-4233-849f-1b788777b139 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.110790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509fee-c3bd-4233-849f-1b788777b139 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.111033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509fee-c3bd-4233-849f-1b788777b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.126318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4796f6e-e2cf-46c5-bb79-d697b1d4ae75 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.127932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a8509fee-c3bd-4233-849f-1b788777b139 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:51.129654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a8509fee-c3bd-4233-849f-1b788777b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:51.160405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.161431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.161711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.161982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.169104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.170537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:39:51.185903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:51.187017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 488/972] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:51.192828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.195152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 485/973] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:51.196469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971862-2d9c-4301-b5aa-3f568c7dd7c7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.196766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971862-2d9c-4301-b5aa-3f568c7dd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.197058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8971862-2d9c-4301-b5aa-3f568c7dd7c7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.201338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 486/974] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:51.202046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8971862-2d9c-4301-b5aa-3f568c7dd7c7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.295021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28093fa-e787-432d-9961-1982fe6c73a5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.301508 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8971862-2d9c-4301-b5aa-3f568c7dd7c7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.328149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.328817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.329121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.329395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.330179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:51.330482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.332755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.333053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.333722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.334014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.334280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.335107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:51.335416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.336828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604f858-78bc-41a8-b623-56128edcf621 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.353972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 487/975] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:51.355210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.355498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.355774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.370755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 489/976] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:51.371692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.372471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:51.373696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:51.445421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 488/977] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:51.446395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.497259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa8c2-c40d-42c2-8652-d5ed839e9bb5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.537568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.538509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.538851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.539198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.539926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.541436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:51.554870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:51.558081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:51.559147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 490/978] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:51.560125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.562169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1007c6-3a54-4736-869d-e2d2c2a1e326 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.601559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.601559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.601559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.601559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.662033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d1ed9-044e-4560-aa7a-ddc09c99c70f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.670907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.672376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.696599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.697241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.697531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.697811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.698530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.699900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.767599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 489/979] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:39:51.768437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.785071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 491/980] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:51 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:51.785071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.889530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859561f5-086b-43b7-92f7-b2e0613a77c3 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.904352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2fd62-c4bb-4de8-b2d4-2ae3f19ce1c2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:51.930066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.931001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.931433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.931851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.932737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:51.933241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.934647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.941320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:51.942785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:51.943065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:51.943334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:51.945448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 490/981] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:51.946515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:51.954907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:51.956871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:39:51.978490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:51.979593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:51.980517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:39:51.980517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:39:51.980517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:39:51.980517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:51.980517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 492/982] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:51.986703 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.048655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1b72-09ab-4e12-a077-5c3a34ac5830 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.083905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.084565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.084843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.085137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.085896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:52.086202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.087524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b4e90-0974-4648-a84d-640de10ede02 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.087692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.093638 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 491/983] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:52.099987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.124969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.125955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.126554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.126970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.127827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:52.128317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.130309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.144650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 493/984] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:52.150281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.206078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e59dee-6804-4c6c-aa64-fd6604c2c691 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.240435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.241112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.241403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.241675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.242465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] RBAC: Adding query filter params (interface=admin, service_id=e061c0caf0b44073a647753ab1f23585, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:52.242773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.244129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.249565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 492/985] 10.222.0.49 () {56 vars in 1249 bytes} [Wed May 11 12:39:52 2022] GET /identity/v3/endpoints?service_id=e061c0caf0b44073a647753ab1f23585&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:52.254580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.256897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c7d1f-6051-449d-a899-fb9e437e4d7c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.291256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.292057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.292342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.292619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.299356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.300944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:39:52.314512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:52.315419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:52.316545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 494/986] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:52.321315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.354332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9864-2814-4e4a-8d92-dccc7d36b264 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.389214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.389880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.390165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.390440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.391120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.392486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.400295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 493/987] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:52 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:39:52.426908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0ca8a-7673-4279-87e0-46c93a11a874 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.462976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.463952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.464471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.464891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.465891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:52.466377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.468021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d444d-a3a0-4188-b9bf-cf46672a4ee7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.488407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 495/988] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:52.489848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:52.598678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c25e2f-b9a8-4c2d-a01a-d67b47d39b21 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:52.632757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:52.633450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:52.633734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:52.634011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:52.635145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] RBAC: Adding query filter params (role.id=66e439aa1c26473696095d8b84a4d9cc, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=70f76bd2fb124f4f9ab3d05cc0146e3d) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:52.635410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:52.636832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae2331-146a-4486-83e3-a0d0e73e4578 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:52.642843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 494/989] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:39:52 2022] GET /identity/v3/role_assignments?user.id=70f76bd2fb124f4f9ab3d05cc0146e3d&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=66e439aa1c26473696095d8b84a4d9cc => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:54.040293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f25e-af18-45c8-b86d-3ba88e23fe86 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.040782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f25e-af18-45c8-b86d-3ba88e23fe86 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.040782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80f25e-af18-45c8-b86d-3ba88e23fe86 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.042303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 496/990] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:54.047372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.047745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.047926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.064226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:54.065978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:54.128846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 495/991] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:54.151695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f25e-af18-45c8-b86d-3ba88e23fe86 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.250821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80f25e-af18-45c8-b86d-3ba88e23fe86 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.282903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.283697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.283990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.284860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.285744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.287081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:54.298763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:54.299846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:54.301382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.305422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 497/992] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:54.306652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.402551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654b1c-cd36-4bc5-af51-fc6c1231555e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.435151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.435813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.436094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.436368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.437109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:54.437513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.438864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.443726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 496/993] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:54.449207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.551384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c511f5-4be8-4961-b978-515be6196974 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.583944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.584619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.584895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.585201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.585904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:54.586207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.587585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76035b3-c7c4-447e-b066-547ac9f07c75 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.598754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 498/994] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:54.600031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.695321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f15f-5beb-4f55-a5db-b69e909ab139 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.695683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f15f-5beb-4f55-a5db-b69e909ab139 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.695899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4f15f-5beb-4f55-a5db-b69e909ab139 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.697365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 499/995] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:54.703962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236fc7d-43f0-4858-b0a7-4c11731a6285 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.704165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.704449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.704726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.723490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:54.724712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:54.744475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.745156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.745442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.745714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.746497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] RBAC: Adding query filter params (interface=public, service_id=0b1db71836e84b07b01d22ad91e2f711, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:54.746803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.748157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.757227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 497/996] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/endpoints?service_id=0b1db71836e84b07b01d22ad91e2f711&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:54.760520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.805143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 500/997] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:54.825855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:54.863253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc320d5d-d69f-4c1c-aeea-2a9b6f4657f2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.897809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.898474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.898755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.899028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.899707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.901093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee7f6-8a2b-431b-bd93-f7eb858a9c87 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.907277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 498/998] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:39:54.908539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1de8-7563-48f8-9ac1-5e96d59fd893 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.908832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1de8-7563-48f8-9ac1-5e96d59fd893 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.909175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b1de8-7563-48f8-9ac1-5e96d59fd893 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.910994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 499/999] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:54.916426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.916715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.916995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.933571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344021d-c45c-433c-815d-ea6a5dd163e5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:54.934793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:54.936244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:54.970346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:54.971176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:54.971457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:54.971789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:54.972545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:54.974035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:54.986658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:54.988524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:39:54.989401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 501/1000] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:54.994361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.021090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 500/1001] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:55.041934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.098285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb3ff-49ae-4381-8f03-7fa5337b9a65 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.135329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.136003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.136283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.136558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.137293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:55.137600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.138965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.143986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 502/1002] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:55.149320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.153336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028a243-38a9-47d4-8f44-f6bdc08f9022 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.186850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.187639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.187926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.188201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] PATH_INFO: `/v3/services/image` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.188857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.190244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:55.202278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:55.203297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:55.204128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 501/1003] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 11 12:39:55 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:39:55.209927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.250930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c977-5f6c-4cfe-ba5c-c1bbad43bc79 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.285733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.286421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.286694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.286970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.287668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:55.287974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.289378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.294315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 503/1004] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 11 12:39:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:55.300267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.307155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aedec-29d3-4fe8-8782-e477d63af856 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.340206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19915786-0153-4324-950b-c69f8f67171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.340873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915786-0153-4324-950b-c69f8f67171f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.341252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915786-0153-4324-950b-c69f8f67171f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.341535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19915786-0153-4324-950b-c69f8f67171f None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.342237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19915786-0153-4324-950b-c69f8f67171f None admin] RBAC: Adding query filter params (name=image) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:55.342545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19915786-0153-4324-950b-c69f8f67171f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.343906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19915786-0153-4324-950b-c69f8f67171f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.348723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 502/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:55.354157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19915786-0153-4324-950b-c69f8f67171f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:55.399510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73ec31-ae99-4755-916c-6ce287e56164 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.432310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.432988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.433304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.433587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.434315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.435749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2a8b3-0a3b-427d-974d-90496082b5bc None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.453821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19915786-0153-4324-950b-c69f8f67171f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:55.486160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:55.486823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:55.487107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:55.487951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:55.488732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] RBAC: Adding query filter params (type=image) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:55.489062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:55.490444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c9738-0114-4e8f-957d-b385b38b1761 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:55.494814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 503/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:55.524109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 504/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:39:57.144675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce811-2571-49ed-b6e9-bd4bf3979416 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.145256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce811-2571-49ed-b6e9-bd4bf3979416 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.145256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ce811-2571-49ed-b6e9-bd4bf3979416 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.146690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 504/1008] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:57.151834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.152216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.152399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.169526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:57.170696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:57.240722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 505/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:39:57.263565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce811-2571-49ed-b6e9-bd4bf3979416 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:57.361903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ce811-2571-49ed-b6e9-bd4bf3979416 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:57.395487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:57.396190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.396471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.396744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] PATH_INFO: `/v3/services/compute` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.397421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:57.398799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:39:57.410242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:39:57.411193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:39:57.412021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 505/1010] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:39:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:39:57.418942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:57.514450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea2a3d-6e34-4ac8-b9a6-c393f9646c8d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:57.549321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:57.550068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.550343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.550623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.551350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:57.551662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:57.553109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:57.563556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 506/1011] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:57.564796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:57.669454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b533abb-e7c0-4779-8298-f24791ed5c6e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:57.702654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:57.703325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.703607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.703880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.704668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:39:57.704974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:57.707172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dababec9-31bf-4fe6-a102-471438f6edb7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:57.716800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 506/1012] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 11 12:39:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:39:57.719114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:57.744372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7219d-79f8-48b4-82d6-83f30413e6dd None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.744662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7219d-79f8-48b4-82d6-83f30413e6dd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.744944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7219d-79f8-48b4-82d6-83f30413e6dd None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.746489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 507/1013] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:39:57.751404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca0fe-783c-45c1-bf98-c70193e4d347 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.751698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca0fe-783c-45c1-bf98-c70193e4d347 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.751982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ca0fe-783c-45c1-bf98-c70193e4d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.768896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4b8ca0fe-783c-45c1-bf98-c70193e4d347 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:57.770291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4b8ca0fe-783c-45c1-bf98-c70193e4d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:57.821145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cbe4-d384-497f-a685-a26921c6d036 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:57.836432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 508/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:57.837812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa467b8-04ef-4243-a37d-4565c69d737b None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.838106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa467b8-04ef-4243-a37d-4565c69d737b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.838388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa467b8-04ef-4243-a37d-4565c69d737b None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.839814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 509/1015] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:39:57.844832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.845157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.845458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.856204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:57.856981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:57.857354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:57.857697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:57.858659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:57.860102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:57.862996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:39:57.864473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:39:57.927806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 510/1016] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:39:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:39:57.928598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:57.939609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 507/1017] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:39:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:57.952018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:58.032153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd898f4-48a4-463c-b3d9-d456d407e3f5 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:58.065150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd55e0c-c479-4fda-9bb7-3c3f52248883 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:58.070008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:58.070973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:58.071405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:58.071824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:58.072716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:58.074160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decb0d8-eb83-4734-aa2e-4bb64189d392 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:58.101994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:58.102810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:58.103097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:58.103371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:58.104638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:58.106197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:58.107879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 508/1018] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:39:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:39:58.113824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:39:58.169475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 511/1019] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:57 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:39:58.219237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1651940-2df5-4615-a22a-70e02bbaf042 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:39:58.264274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:39:58.264962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:39:58.265285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:39:58.265564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:39:58.266284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:39:58.267770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91f609-48fb-4edf-9dc8-127a436f7593 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:39:58.385244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 509/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:39:58 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:40:00.316332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1729b3-8ce9-4733-9da9-0733939b0e4a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.316884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1729b3-8ce9-4733-9da9-0733939b0e4a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.317178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1729b3-8ce9-4733-9da9-0733939b0e4a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.318496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 512/1021] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:00.324060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d979a-6862-4f70-a5f0-909acf8336b6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.324513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d979a-6862-4f70-a5f0-909acf8336b6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.324618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d979a-6862-4f70-a5f0-909acf8336b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.341632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bc2d979a-6862-4f70-a5f0-909acf8336b6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:00.342809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bc2d979a-6862-4f70-a5f0-909acf8336b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:00.410210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 510/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:00.424447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23720a3e-de8a-442d-9838-3fa91fe35195 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.425342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23720a3e-de8a-442d-9838-3fa91fe35195 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.425666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23720a3e-de8a-442d-9838-3fa91fe35195 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.427192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 513/1023] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:00.432361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.432653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.433262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.433963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23720a3e-de8a-442d-9838-3fa91fe35195 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.450390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:00.451817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:00.518119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 511/1024] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:00.535394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23720a3e-de8a-442d-9838-3fa91fe35195 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.540372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.569544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.570233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.570517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.570796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.580941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:00.589291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:00.590483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:00.591498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 514/1025] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:00.596880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.647391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1916f5-879a-4f04-a6da-3b7ac0d32a15 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.683692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.684402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.684686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.684961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] PATH_INFO: `/v3/services/image` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.685652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:00.690772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:00.701992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519fda-e266-4a27-83e1-43d6a6e31424 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:00.702707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:00.703645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:00.704477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:00.709313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 512/1026] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:00.710148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.736601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.738112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.738438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.738807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.739712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:00.739712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:00.741169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:00.754992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 515/1027] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:00.755951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.814725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc503de7-f084-4bf6-a605-e6151c24fb77 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.847820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.848491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.848774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.849061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.849775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] RBAC: Adding query filter params (name=image) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:00.850083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:00.851472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d293341-0925-4467-9d54-6d0dc4b79c94 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:00.856913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a557a-6d3a-4a17-9544-bcc91594e300 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.857431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 513/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:00.863220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a2bf-0576-4eac-93fa-cf74e7ad8fb9 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.863220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a2bf-0576-4eac-93fa-cf74e7ad8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.863220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a2bf-0576-4eac-93fa-cf74e7ad8fb9 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.863220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 514/1029] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:00.864443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a2bf-0576-4eac-93fa-cf74e7ad8fb9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:00.891509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.892483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.892834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.893993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.905390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:00.906844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-22083093-3c01-4272-8bf5-9f5836198e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:00.923310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:00.924208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:00.925548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:00.925548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:00.925548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:00.925548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:00.925548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 516/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:00.926568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.926853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.927131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.943977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:00.945188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:00.963782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a2bf-0576-4eac-93fa-cf74e7ad8fb9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:00.994891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:00.995552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:00.995838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:00.996116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:00.996812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:00.997144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:00.998503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.003703 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 515/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:01.005918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.009164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 517/1032] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:01.010242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.103922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292d52a-eee8-45d7-a3b0-1632fd018f7a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.106670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158688d3-c235-4e8e-91c5-1ec2b067f2c9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.136921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.137604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.137888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.138164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.138943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] RBAC: Adding query filter params (interface=public, service_id=2be99938484e42c7bb5763f841a4e53f, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:01.139253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.139607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.140267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.140548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.140637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.140818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.141558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:01.141869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.143260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.145555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 518/1033] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/endpoints?service_id=2be99938484e42c7bb5763f841a4e53f&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:01.146321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.155233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 516/1034] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:01.156025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.243668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cb65d-6a2d-47e0-bd9c-76f4f75d9437 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.256042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f9f1b-ed4d-4ffd-8a2e-0b87f390bcc9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.277602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.278387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.278672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.278948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.280125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.281590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.283222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 519/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:01.284547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.290610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.291281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.291564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.291839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.292529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.293927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.317084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 517/1036] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:40:01.317084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.388960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7ed8-944c-4edc-8207-77e6571f35bd None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.408554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433dcd-feae-4f51-b978-c1afbc5f9e26 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.424962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.425803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.426088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.426363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.434155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.435640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.445579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.446260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.446539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.446812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.447528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.448966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:40:01.451854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:01.452829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:01.454524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:01.458912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 520/1037] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:01.459876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.554370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 518/1038] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:40:01 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:01.560030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20fbad-77f8-4757-9a28-14adb41dbd86 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.598625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.599316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.599599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.599875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.600727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:01.601178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.602549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.627491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 521/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:01.629746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:01.742638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c3ee7-1177-4792-8b5e-139b3dfb4d73 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:01.776753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:01.777452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:01.777736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:01.778008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:01.847431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:01.848895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:01.942991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 519/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:01.948359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:02.042639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee22153-62d6-451f-849d-62e986d2813f None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:02.075766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:02.076553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:02.076834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:02.077132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:02.087745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:02.089207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:02.106826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:02.107773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:02.108666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:02.108666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:02.108666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:02.108666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:02.112682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 522/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:02.113701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:02.209573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9447a-036d-4058-9694-bbb2d607b394 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:02.242054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:02.242771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:02.243049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:02.243318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:02.244021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:02.244323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:02.245760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:02.256710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 520/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:02.262242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:02.356812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36822-6938-468f-a435-ae1f43626ea9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:02.389585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:02.390373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:02.390653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:02.390928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:02.398197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:02.399718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:40:02.413781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:02.414712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:02.415582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:02.417404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 523/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:02.420757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:02.530006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a4a0e-cef3-4d66-90c0-42a9b0543513 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:02.564635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:02.565582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:02.565928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:02.566211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:02.567007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:02.567320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:02.568779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888e247-a100-4f11-8252-c04a54e4b6ad None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:02.587049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 521/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:02.588598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:02.697001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704853e-4548-43df-9c1a-3c39ac44b328 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:02.733645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:02.734302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:02.734585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:02.734857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:02.735685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] RBAC: Adding query filter params (role.id=66e439aa1c26473696095d8b84a4d9cc, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:02.735998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:02.737715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c40cb-5053-47d5-96da-e839574b7ce2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:02.749159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 524/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:02 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=66e439aa1c26473696095d8b84a4d9cc => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:03.529667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ea8c-7075-473a-a142-7523e622f86b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.530214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ea8c-7075-473a-a142-7523e622f86b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.530214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ea8c-7075-473a-a142-7523e622f86b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.531580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 522/1046] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:03.537757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.538181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.542438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.555286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:03.556478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:03.620931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 525/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:03.643963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570ea8c-7075-473a-a142-7523e622f86b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:03.745964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570ea8c-7075-473a-a142-7523e622f86b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:03.782062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:03.782778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.783061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.783331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] PATH_INFO: `/v3/services/image` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.784483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:03.785881 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-7055ad67-050c-4886-9b3d-c8b2424ff407 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:03.797382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:03.798462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:03.805118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 523/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 11 12:40:03 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:03.805917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:03.905076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a1df-87f1-464e-badb-7e06b1e917f2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:03.937723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:03.938385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.938669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.938945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.939649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] RBAC: Adding query filter params (name=image) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:03.940521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:03.942324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:03.946767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559ea9-d2a4-492d-922d-5abed42c7518 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.947055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559ea9-d2a4-492d-922d-5abed42c7518 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.947475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559ea9-d2a4-492d-922d-5abed42c7518 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.947603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 526/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:03.948684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 524/1050] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:40:03.953220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:03.959077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:03.959370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:03.959647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:03.979640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:03.980827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:04.052365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f104a90-a6c1-4e17-bd89-ad256db662ab None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.053349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 525/1051] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:04.069006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.084778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.085475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.085760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.086035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.086735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] RBAC: Adding query filter params (type=image) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:04.087050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:04.088410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:04.097856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 527/1052] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:04.098761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.168455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a200ad-fdf3-472f-99c4-efb7ed9c6aea None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.196547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad53959-70b7-4a75-bd97-c3fe73b778fd None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.202659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.203708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.204063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.204344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.215003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:04.229669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.230331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.230615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.230891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.231640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:04.233016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:04.235519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:04.236442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:04.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 526/1053] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:04.244730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.323131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 528/1054] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:40:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:40:04.348429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04d17-86eb-46aa-8e8d-70762461d32c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.394542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.395638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.396117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.396586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.397590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:04.398097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:04.399706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:04.416264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 527/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:04.418016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.536285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b895-9c10-4e6d-a285-685e7c9ac8d1 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.579798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.582316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.584943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.585279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] PATH_INFO: `/v3/users/c4c46876fb534f2ab04639f4bda0a93d` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.618096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c46876fb534f2ab04639f4bda0a93d)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:04.619543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:04.625276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 529/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:04 2022] GET /identity/v3/users/c4c46876fb534f2ab04639f4bda0a93d => generated 285 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:04.627208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.724354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327f2b-17c2-4322-be48-7e5ff3b9f75d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:04.757970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:04.758620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.758905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.759174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.831540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:04.833785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c53484-243c-4f2c-a68e-be3c2dc72918 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:04.931946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 528/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:04.937832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:04.979189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a907-0633-4d2b-931b-11d84aa422e0 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.979514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a907-0633-4d2b-931b-11d84aa422e0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.979746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a907-0633-4d2b-931b-11d84aa422e0 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:04.981392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 529/1058] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:40:04.985973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:04.986270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:04.986549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.003329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:05.004504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:05.033673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05021740-cfd7-4a88-8eca-69a6838863f3 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.067416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.068272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.068558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.068833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.070326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.070442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 530/1059] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:05.071473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.077968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 530/1060] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:04 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:05.079408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.092826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.178158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dc98c-2148-44ff-996e-ae50e7112f58 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.189708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c20788-baac-4874-ade8-7fa90c2a9c82 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.211035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.211701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.211982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.212254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.213106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=59a69f46452a41f08e6ec46bcc107030, user.id=c4c46876fb534f2ab04639f4bda0a93d) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:05.213422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.214857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.220242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 531/1061] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/role_assignments?user.id=c4c46876fb534f2ab04639f4bda0a93d&scope.project.id=59a69f46452a41f08e6ec46bcc107030&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:05.232297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.233203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.233491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.233766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.246233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:05.254660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:05.255924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:05.262147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 531/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:05.262930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.365830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131ec-6bc5-4c00-bf30-fffe4b2d2894 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.402278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.402694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.402980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.403595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.404000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:05.405025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.406688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.415098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 532/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:05.420490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.517988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819a016-8b0a-4a92-bc41-75f34bffc1da None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.550707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244670-913d-4254-93af-77e120f77476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.551504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244670-913d-4254-93af-77e120f77476 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.551790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244670-913d-4254-93af-77e120f77476 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.552063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73244670-913d-4254-93af-77e120f77476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.562571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244670-913d-4254-93af-77e120f77476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.564028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73244670-913d-4254-93af-77e120f77476 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-73244670-913d-4254-93af-77e120f77476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:05.581544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:05.584917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:05.586213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:05.586213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:05.586213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:05.586213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:05.586213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 532/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:05.588370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.717587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d04e0-d1bf-4c4c-9e6f-2c662647d54b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.751489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.752154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.753013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.753348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.754069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:05.754376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.755742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.771460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 533/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:05.773530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244670-913d-4254-93af-77e120f77476 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:05.871501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73244670-913d-4254-93af-77e120f77476 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:05.904992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:05.905808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:05.906092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:05.906369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:05.914026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:05.915475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:40:05.930402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:05.931493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:05.932452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:05.933643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 533/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:05.937414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.034647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51074-0dea-416f-8d16-8b524fbd997b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.067685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf563a-7021-44b7-816d-274121919000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.068359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf563a-7021-44b7-816d-274121919000 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.068643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf563a-7021-44b7-816d-274121919000 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.068919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf563a-7021-44b7-816d-274121919000 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.069792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf563a-7021-44b7-816d-274121919000 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:06.070098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf563a-7021-44b7-816d-274121919000 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.071519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf563a-7021-44b7-816d-274121919000 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.092460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 534/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:40:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:06.093777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.190486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417411cd-2192-4a06-addf-8728ea523395 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.222495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.223280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.223561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.223832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.233935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.235364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:06.252077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:06.253870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:06.254749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:06.254749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:06.254749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:06.254749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:06.257370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 534/1068] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:06.259827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf563a-7021-44b7-816d-274121919000 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.361212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf563a-7021-44b7-816d-274121919000 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.395805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.396470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.396748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.397019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.397765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:06.398069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.399423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.414903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 535/1069] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:06.416188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.519294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f870ff-f4ac-468a-bfb8-76a364695df5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.551563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.552350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.552635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.552911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.559391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.560836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-feed6f58-fc23-4b5d-ad7e-550a935e68e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:40:06.574785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:06.575692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:06.576572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:06.581267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 535/1070] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:06.583696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.641775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf218b8-6655-4800-bbfb-8ab41e598a02 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.642286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf218b8-6655-4800-bbfb-8ab41e598a02 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.642286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf218b8-6655-4800-bbfb-8ab41e598a02 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.644299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 536/1071] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:40:06.648940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.649260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.649543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.669246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:06.670713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:06.680556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6576db-97f4-4760-86b2-561924d02675 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.720217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.720965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.721805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.722080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.723054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:06.723355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.724783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.738273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 536/1072] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:06.743403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 537/1073] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:06.743763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.765419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:06.842689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c7cc-0384-4805-b28f-edb095b4e015 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.861137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d4b99-4e04-4aeb-b06b-913c3cef6a52 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:06.878912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.879807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.880091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.880370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/66e439aa1c26473696095d8b84a4d9cc` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.882624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=9bd3d5788bc74f70a942f44f2f38dfca, role_id=66e439aa1c26473696095d8b84a4d9cc)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.884052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:06.898037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:06.898621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:06.898900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:06.899170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:06.953206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 537/1074] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:40:06 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/9bd3d5788bc74f70a942f44f2f38dfca/roles/66e439aa1c26473696095d8b84a4d9cc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:40:06.974779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:06.976337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:07.087268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 538/1075] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 12:40:07.088982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:07.195673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a23750-7efe-4766-bfcb-e81ceac8fda6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:07.229293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:07.230096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.230378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.230652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.241481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:07.243106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ff948cb7-e5ab-43af-970a-3dbfd5aa732a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:07.263875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:07.264815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:07.266057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:07.266057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:07.266057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:07.266057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:07.266647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 538/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:07.272120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:07.372621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504561-0a0d-4de4-8a48-11511d428589 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:07.406022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:07.406683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.406963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.407237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.407949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:07.408277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:07.410549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6cb2f-d94f-4406-a005-0838d20cb463 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:07.429080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 539/1077] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:07.499163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3100-5d27-4a52-ae51-cd95d6e5637e None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.499411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3100-5d27-4a52-ae51-cd95d6e5637e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.499645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc3100-5d27-4a52-ae51-cd95d6e5637e None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.501300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 539/1078] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:07.507451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.507743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.508024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.526504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:07.527731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:07.599144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 540/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:07.631946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc3100-5d27-4a52-ae51-cd95d6e5637e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:07.742830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc3100-5d27-4a52-ae51-cd95d6e5637e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:07.775860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:07.776575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.776856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.777161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.787441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:07.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:07.796112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:07.796995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 540/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:07.802880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:07.896487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751cbde-92b1-479f-ac17-4196a2d66527 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:07.928476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:07.929156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:07.929442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:07.929715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:07.930444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:07.930748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:07.932114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:07.940295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 541/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:07.946442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:08.042326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a918e-f8d5-4212-bb51-61191c85dc46 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:08.074554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:08.075420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:08.075700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:08.075969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] PATH_INFO: `/v3/users/c4c46876fb534f2ab04639f4bda0a93d` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:08.077155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c46876fb534f2ab04639f4bda0a93d)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:08.078583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:08.080242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 541/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:07 2022] GET /identity/v3/users/c4c46876fb534f2ab04639f4bda0a93d => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:08.086857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:08.183048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0319b-37e2-4cb0-a0f6-ce1e6fff69b7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:08.215371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:08.216224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:08.216509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:08.216787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:08.217990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:08.219413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe663051-d3fc-4edb-a217-19fb77111905 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:08.221792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 542/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:08 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:08.227733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:08.322031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5884-a2ca-4500-b35e-9b4abd7edba4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:08.353893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:08.354773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:08.355058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:08.355334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030/users/c4c46876fb534f2ab04639f4bda0a93d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:08.357287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=59a69f46452a41f08e6ec46bcc107030, user_id=c4c46876fb534f2ab04639f4bda0a93d, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:08.358719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51950-da7e-46ad-8499-c208e1b08e5f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:08.438082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 542/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:40:08 2022] PUT /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030/users/c4c46876fb534f2ab04639f4bda0a93d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:40:09.197398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d1be-b5c8-4336-8c4e-ca4f4285529e None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.197922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d1be-b5c8-4336-8c4e-ca4f4285529e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.198010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18d1be-b5c8-4336-8c4e-ca4f4285529e None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.199352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 543/1085] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:09.204673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.205104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.205265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.222150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:09.223322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:09.294263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 543/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:09.317594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18d1be-b5c8-4336-8c4e-ca4f4285529e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:09.413288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18d1be-b5c8-4336-8c4e-ca4f4285529e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:09.445246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:09.446049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.446333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.446607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.457147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:09.465254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:09.466344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:09.467191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 544/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 11 12:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:09.472796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:09.569430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff033-d6f5-4342-9804-206fc9e3306b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:09.601679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:09.602352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.602636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.602935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.603668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:09.603979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:09.605381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:09.613718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 544/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:09.619386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:09.718060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce191-8ee4-4566-b096-13a15ade2161 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:09.750705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:09.751480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.751762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.752030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.761969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:09.763401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:09.780071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:09.781188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:09.782382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:09.782382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:09.782382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:09.782382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:09.785203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 545/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:09.787419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:09.882154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1c0bc-a2dd-417d-99b8-95eda94b1117 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:09.914439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:09.915097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:09.915383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:09.915658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:09.916380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:09.916687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:09.918093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:09.929971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 545/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:09.935460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.029021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97787bc-cb03-44de-b576-e6cbf3e27c0b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.061503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.062291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.062577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.062855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.070429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:10.071881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:40:10.086118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:10.087215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:10.088167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 546/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 11 12:40:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:10.092964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.199278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b854c8c-871b-4b20-951b-94cdbffdf0fa None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.233055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.233741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.234020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.234290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.235107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:10.235410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:10.236943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:10.253481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 546/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:10.258865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.357004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f7817-2bb2-442d-9037-9019af3d3a49 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.388309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.388942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.389246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.389515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.453510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:10.455012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d0daa-b03b-4599-907a-53fa7ff30be8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:10.550394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 547/1093] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:10.556063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.634284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697e7a-b927-4819-a333-5d948ed6a189 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.634732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697e7a-b927-4819-a333-5d948ed6a189 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.634997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36697e7a-b927-4819-a333-5d948ed6a189 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.636398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 548/1094] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:40:10.641981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.642289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.642657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.655549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee95b1-1917-4458-b748-283e3e73552b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.660319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:10.661532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:10.687642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.688454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.688740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.689018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.699883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:10.701356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:10.718914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:10.719911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:10.720849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:40:10.720849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:10.720849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:40:10.720849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:10.720849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:10.725654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.729258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 549/1096] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:10.752030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.820759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72286f-be35-4fea-94d8-61c28628d57f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.847597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ca2fe-fee2-451d-8b6e-15ee48518194 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:10.853316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.853976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.854262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.854539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.855247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:10.855552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:10.856915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:10.868560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 548/1097] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:10.874108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.881933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:10.882724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:10.883009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:10.883280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:10.893930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:10.901381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:10.902311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:10.903144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 550/1098] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:10.908667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:10.969679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e951b5a-e7b2-4878-a37a-1a1a7585e183 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.000518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14eeaa-ab51-465d-bc48-014710bc1115 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.001631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.003002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.003463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.003742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.010547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.011990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:40:11.026168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:11.027137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:11.028454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 549/1099] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 12:40:11.032796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.032988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.033587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.034079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.034079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.034798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:11.035101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.036467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.044818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 551/1100] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:11.051148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.126500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f4e94-fd5b-4480-9c39-9c512d218db4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.143610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173c995-29f0-4564-989c-3e596a1559ce None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.159373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.159982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.160267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.160545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.161434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:11.161750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.163187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.175181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 550/1101] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:11.177963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.178905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.179253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.179603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] PATH_INFO: `/v3/users/c4c46876fb534f2ab04639f4bda0a93d` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.180956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] RBAC: Authorizing `identity:get_user(user_id=c4c46876fb534f2ab04639f4bda0a93d)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.181081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.182526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.188575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 552/1102] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/users/c4c46876fb534f2ab04639f4bda0a93d => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:11.189653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.276074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439b22-c1af-44ec-8f67-31282c0d27ba None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.282312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0906f-850e-4789-a184-f450b3418446 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.307736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.308394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.308676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.308958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.309811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] RBAC: Adding query filter params (role.id=66e439aa1c26473696095d8b84a4d9cc, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=9bd3d5788bc74f70a942f44f2f38dfca) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:11.310125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.311554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.313603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.314238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.315086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.315361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.318271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/role_assignments?user.id=9bd3d5788bc74f70a942f44f2f38dfca&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=66e439aa1c26473696095d8b84a4d9cc => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:11.384869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.386363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.486036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 553/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 12:40:11.492516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.591609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95663c58-63ff-4997-9274-c08bd6138bf6 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.625823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.626713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.627097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.627397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.628662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.630128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371107fd-7609-486e-a7c6-e8319d16d42d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.631875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:11.638448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:11.741257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db24159-23bc-4db6-84b6-222848b944a9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:11.774915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:11.775562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:11.775847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:11.776117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:11.776942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=59a69f46452a41f08e6ec46bcc107030, user.id=c4c46876fb534f2ab04639f4bda0a93d) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:11.777323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:11.778745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df0265-112f-4e73-9fcd-db0a585bb13a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:11.785212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:11 2022] GET /identity/v3/role_assignments?user.id=c4c46876fb534f2ab04639f4bda0a93d&scope.project.id=59a69f46452a41f08e6ec46bcc107030&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:14.016333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025bc7-aeeb-41a5-999e-363b460f6e58 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:14.016833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025bc7-aeeb-41a5-999e-363b460f6e58 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:14.016833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025bc7-aeeb-41a5-999e-363b460f6e58 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:14.018920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:14.024072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:14.024489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:14.024630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:14.041260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:14.042430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:14.103448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:14.128443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025bc7-aeeb-41a5-999e-363b460f6e58 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:14.226309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025bc7-aeeb-41a5-999e-363b460f6e58 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:14.258122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:14.258892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:14.259170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:14.259691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:14.260838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:14.262289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253200e-97be-435d-b8f6-0a00a799b3fb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:14.263886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:14.270195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:14.360637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3c91-269d-4ef2-ab7d-ac619d1da751 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:14.393434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:14.394080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:14.394357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:14.394624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:14.395329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:14.396746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406c678-c570-4a97-bf7c-bd7fb73e9966 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:14.495073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:40:14 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:16.762316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273c35-44af-42dd-b5f1-2c2c87cd55fd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:16.762834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273c35-44af-42dd-b5f1-2c2c87cd55fd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:16.763335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b273c35-44af-42dd-b5f1-2c2c87cd55fd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:16.765143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:16.771321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:16.771741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:16.771869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:16.788935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:16.790151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:16.857997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:16.882630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b273c35-44af-42dd-b5f1-2c2c87cd55fd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:16.980091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b273c35-44af-42dd-b5f1-2c2c87cd55fd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:17.012250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:17.013118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:17.013398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:17.013668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] PATH_INFO: `/v3/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:17.015107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] RBAC: Authorizing `identity:get_role(role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:17.016462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:17.018189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:16 2022] GET /identity/v3/roles/fa903e57f2f4461fb91b94163f747824 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:17.023842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:17.123624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f159ab4-777d-47a8-99c5-7a084cf9ea0b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:17.158502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:17.159350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:17.159627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:17.159897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] PATH_INFO: `/v3/users/68b0b73e18e540ebad55ca9f92f537f3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:17.172016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] RBAC: Authorizing `identity:get_user(user_id=68b0b73e18e540ebad55ca9f92f537f3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:17.173469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:17.175695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:17 2022] GET /identity/v3/users/68b0b73e18e540ebad55ca9f92f537f3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:17.181579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:17.276562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147080f-41a9-4e50-ae96-c4f1a369e38b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:17.308520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:17.309185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:17.309474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:17.309752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:17.373526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:17.374971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:17.480996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:17.487570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:17.578998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c863-ae7e-4509-9a42-df20ba5aa50b None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:17.610600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:17.611991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:17.612362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:17.612636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:17.613820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:17.615238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e52087-1512-4579-8f84-d5446431834a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:17.616912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:17 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:17.623060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:17.716944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9280755-d620-4c00-8577-737dfcfc5a98 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:17.749166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:17.749811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:17.750094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:17.750369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:17.751189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=59a69f46452a41f08e6ec46bcc107030, user.id=68b0b73e18e540ebad55ca9f92f537f3) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:17.751499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:17.753691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b5496-6e7e-4a9d-b84b-d19b3e4d0745 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:17.758901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:17 2022] GET /identity/v3/role_assignments?user.id=68b0b73e18e540ebad55ca9f92f537f3&scope.project.id=59a69f46452a41f08e6ec46bcc107030&role.id=fa903e57f2f4461fb91b94163f747824 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:19.947018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d940c-b39e-4a6d-aa4d-2be4bcd5018f None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:19.947534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d940c-b39e-4a6d-aa4d-2be4bcd5018f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:19.947534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d940c-b39e-4a6d-aa4d-2be4bcd5018f None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:19.948863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:19.954002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:19.954414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:19.954561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:19.970761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:19.971959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:20.036592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:20.062596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d940c-b39e-4a6d-aa4d-2be4bcd5018f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:20.159942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d940c-b39e-4a6d-aa4d-2be4bcd5018f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:20.191423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:20.192261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:20.192544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:20.192817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] PATH_INFO: `/v3/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:20.194305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] RBAC: Authorizing `identity:get_role(role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:20.195666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:20.197105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:20 2022] GET /identity/v3/roles/fa903e57f2f4461fb91b94163f747824 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:20.202844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:20.296083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59aff3-4b29-4154-807d-c0748a5ee74f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:20.327900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:20.328754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:20.329063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:20.329346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] PATH_INFO: `/v3/users/68b0b73e18e540ebad55ca9f92f537f3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:20.331278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] RBAC: Authorizing `identity:get_user(user_id=68b0b73e18e540ebad55ca9f92f537f3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:20.332718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:20.334378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:20 2022] GET /identity/v3/users/68b0b73e18e540ebad55ca9f92f537f3 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:20.340115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:20.436019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744176c-dfa4-45da-85e3-5385e42a1f06 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:20.468551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:20.469358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:20.469672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:20.469948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:20.471275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:20.472671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782c943-b636-4c5a-acf0-e0af13de4c92 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:20.474474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:20 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:20.480438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:20.578240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2acfa6-04af-4463-82d4-de6df365d5ce None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:20.612819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:20.613728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:20.614014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:20.614284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030/users/68b0b73e18e540ebad55ca9f92f537f3/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:20.616452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=59a69f46452a41f08e6ec46bcc107030, user_id=68b0b73e18e540ebad55ca9f92f537f3, role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:20.617900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5d2f5-1957-43bb-80a8-294fea3a9c9e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:20.693224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:40:20 2022] PUT /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030/users/68b0b73e18e540ebad55ca9f92f537f3/roles/fa903e57f2f4461fb91b94163f747824 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:40:22.907092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9138-b9d9-46e2-8cca-3a3ecca24d05 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:22.907611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9138-b9d9-46e2-8cca-3a3ecca24d05 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:22.907726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9138-b9d9-46e2-8cca-3a3ecca24d05 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:22.909710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:22.914837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035864a2-1395-474e-963b-a93814463222 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:22.915230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035864a2-1395-474e-963b-a93814463222 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:22.915388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035864a2-1395-474e-963b-a93814463222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:22.931604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-035864a2-1395-474e-963b-a93814463222 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:22.932771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-035864a2-1395-474e-963b-a93814463222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:22.996241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:23.020046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9138-b9d9-46e2-8cca-3a3ecca24d05 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:23.120797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9138-b9d9-46e2-8cca-3a3ecca24d05 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:23.152938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:23.153804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:23.154085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:23.154357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] PATH_INFO: `/v3/roles/fa903e57f2f4461fb91b94163f747824` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:23.155810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] RBAC: Authorizing `identity:get_role(role_id=fa903e57f2f4461fb91b94163f747824)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:23.157209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:23.159248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:23 2022] GET /identity/v3/roles/fa903e57f2f4461fb91b94163f747824 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:23.164978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035864a2-1395-474e-963b-a93814463222 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:23.257716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035864a2-1395-474e-963b-a93814463222 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:23.290931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:23.291786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:23.292068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:23.292343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] PATH_INFO: `/v3/users/68b0b73e18e540ebad55ca9f92f537f3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:23.293544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] RBAC: Authorizing `identity:get_user(user_id=68b0b73e18e540ebad55ca9f92f537f3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:23.294966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:23.296581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:23 2022] GET /identity/v3/users/68b0b73e18e540ebad55ca9f92f537f3 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:23.302322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:23.395580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd6168-4998-42d7-9b30-e66a844ebebe None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:23.429340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:23.429986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:23.430276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:23.430553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:23.493052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:23.494500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:23.585030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:23.590910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:23.683948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db619-b972-4bf2-8208-41156d4f7129 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:23.716593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:23.717478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:23.717759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:23.718032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] PATH_INFO: `/v3/projects/59a69f46452a41f08e6ec46bcc107030` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:23.719196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] RBAC: Authorizing `identity:get_project(project_id=59a69f46452a41f08e6ec46bcc107030)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:23.721252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417f4a-6dcc-468f-a777-1f046bca3631 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:23.722941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:23 2022] GET /identity/v3/projects/59a69f46452a41f08e6ec46bcc107030 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:23.728906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:23.820384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24e5-af44-4938-9dc3-10c618fc8ef9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:23.852671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:23.853276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:23.853560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:23.853836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:23.854655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] RBAC: Adding query filter params (role.id=fa903e57f2f4461fb91b94163f747824, scope.project.id=59a69f46452a41f08e6ec46bcc107030, user.id=68b0b73e18e540ebad55ca9f92f537f3) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:23.854968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:23.856385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863a8df-e2c7-4afd-9460-78d4586d4583 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:23.862224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:23 2022] GET /identity/v3/role_assignments?user.id=68b0b73e18e540ebad55ca9f92f537f3&scope.project.id=59a69f46452a41f08e6ec46bcc107030&role.id=fa903e57f2f4461fb91b94163f747824 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:26.068380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef11d-891b-4e73-9049-0b94fe69baad None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:26.068899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef11d-891b-4e73-9049-0b94fe69baad None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:26.068899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef11d-891b-4e73-9049-0b94fe69baad None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:26.070292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:26.075749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:26.076169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:26.076310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:26.092950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:26.094156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:26.160524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:26.184445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbef11d-891b-4e73-9049-0b94fe69baad None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:26.292385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbef11d-891b-4e73-9049-0b94fe69baad None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:26.324747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:26.325540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:26.325824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:26.326106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:26.327310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:26.328728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4665c-c121-4667-9e05-b6060e3d968c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:26.330628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:26.336389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:26.428906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764a933-dabf-4efd-99d6-5e6628111066 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:26.461083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:26.461727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:26.462011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:26.462314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:26.463004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:26.464431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271c9c2-30b8-448b-afc6-219cce8fc386 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:26.573616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:40:26 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:28.804733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6d45-c15a-4d2e-9dbc-a1c74c199a7a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:28.805278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6d45-c15a-4d2e-9dbc-a1c74c199a7a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:28.805366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa6d45-c15a-4d2e-9dbc-a1c74c199a7a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:28.806676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:28.811864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:28.812235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:28.812542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:28.829128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:28.830935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:28.894150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:28.918291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa6d45-c15a-4d2e-9dbc-a1c74c199a7a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:29.015600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa6d45-c15a-4d2e-9dbc-a1c74c199a7a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:29.047824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:29.049283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:29.049570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:29.049843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:29.051009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:29.052433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72819c22-3214-4da7-b84a-702a80255ce4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:29.054079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:40:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:29.059792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:29.152562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10d8ee-4b9f-44b6-ae99-9bde736caae6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:29.184288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:29.184941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:29.185252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:29.185528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:29.186233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:29.187655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce90a95-abce-43e6-833b-7e88fe0c4463 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:29.274980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:40:29 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:40:31.552301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf99f-6fc1-4558-b713-c494874c482e None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:31.552857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf99f-6fc1-4558-b713-c494874c482e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:31.552857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf99f-6fc1-4558-b713-c494874c482e None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:31.554303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:31.559536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:31.559939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:31.560083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:31.580816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:31.582392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:31.650961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:31.675614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf99f-6fc1-4558-b713-c494874c482e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:31.772310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf99f-6fc1-4558-b713-c494874c482e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:31.805061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:31.805791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:31.806074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:31.806347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:31.816137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:31.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:31.824721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:31.825784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:31.831388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:31.932931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f283514-ecc7-4087-af62-9dbc640c5d22 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:31.964968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:31.965646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:31.965928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:31.966198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:31.966927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:31.967230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:31.968584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:31.977123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:31.982865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:32.075047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5783c-ab8e-432c-bec4-d643f8969b46 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:32.106803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:32.107657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:32.107939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:32.108214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] PATH_INFO: `/v3/users/ea4f07147e4549bd81d0d408c5ca76fb` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:32.120511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] RBAC: Authorizing `identity:get_user(user_id=ea4f07147e4549bd81d0d408c5ca76fb)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:32.121975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:32.123599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:31 2022] GET /identity/v3/users/ea4f07147e4549bd81d0d408c5ca76fb => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:32.129375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:32.228738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b07eca-0349-4c16-aece-97dc807d38cf None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:32.263678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:32.264321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:32.264603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:32.264879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:32.328207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:32.330203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:32.420832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:32.427049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:32.521836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed41ddd-53fd-415b-9495-5462a13b931b None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:32.553883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:32.554742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:32.555020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:32.555287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] PATH_INFO: `/v3/projects/554f93838c5e42a988192b226de369c1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:32.556464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] RBAC: Authorizing `identity:get_project(project_id=554f93838c5e42a988192b226de369c1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:32.558615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99164f-638a-4eb7-b8b7-60d9bd07a537 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:32.560596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:32 2022] GET /identity/v3/projects/554f93838c5e42a988192b226de369c1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:32.567166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:32.663907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3014f-91c5-4b75-9864-e739e5c84fad None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:32.696134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:32.696771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:32.697067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:32.697633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:32.699061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=554f93838c5e42a988192b226de369c1, user.id=ea4f07147e4549bd81d0d408c5ca76fb) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:32.699061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:32.699868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813a9f4-7d3e-4ef5-965b-f690430dea84 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:32.705272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:32 2022] GET /identity/v3/role_assignments?user.id=ea4f07147e4549bd81d0d408c5ca76fb&scope.project.id=554f93838c5e42a988192b226de369c1&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:34.880621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dc5a-cd5c-4c1c-a5af-86ae2ca012bf None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:34.881208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dc5a-cd5c-4c1c-a5af-86ae2ca012bf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:34.881346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70dc5a-cd5c-4c1c-a5af-86ae2ca012bf None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:34.882739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:34.888380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:34.888772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:34.888947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:34.905487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:34.906682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:34.976496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:34.999436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70dc5a-cd5c-4c1c-a5af-86ae2ca012bf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:35.096336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70dc5a-cd5c-4c1c-a5af-86ae2ca012bf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:35.127419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:35.128189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:35.128465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:35.128731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:35.138959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:35.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:35.148434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:35.149564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:35.154708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:35.275127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cca7d2-79aa-485f-bc65-b68aca2b25b7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:35.307287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:35.307939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:35.308222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:35.308497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:35.309259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:35.309568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:35.310928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:35.319193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:35.325282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:35.418623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8e520-3183-4584-a5b0-0ee7613ebd99 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:35.449712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:35.450566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:35.450846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:35.451120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] PATH_INFO: `/v3/users/ea4f07147e4549bd81d0d408c5ca76fb` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:35.452282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4f07147e4549bd81d0d408c5ca76fb)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:35.453739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:35.455900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:35 2022] GET /identity/v3/users/ea4f07147e4549bd81d0d408c5ca76fb => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:35.461563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:35.567504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c597-af8b-47d2-a3ab-fcc4d9a605da None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:35.605568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:35.606408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:35.606690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:35.606959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] PATH_INFO: `/v3/projects/554f93838c5e42a988192b226de369c1` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:35.608106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] RBAC: Authorizing `identity:get_project(project_id=554f93838c5e42a988192b226de369c1)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:35.609561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239b748-3b38-48da-b59b-02e10a308e9b None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:35.612096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:35 2022] GET /identity/v3/projects/554f93838c5e42a988192b226de369c1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:35.618124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:35.712901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819923ce-89ba-4ab3-8ad5-0e70c26e3fb3 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:35.744619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:35.745520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:35.745802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:35.746073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] PATH_INFO: `/v3/projects/554f93838c5e42a988192b226de369c1/users/ea4f07147e4549bd81d0d408c5ca76fb/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:35.747982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] RBAC: Authorizing `identity:create_grant(project_id=554f93838c5e42a988192b226de369c1, user_id=ea4f07147e4549bd81d0d408c5ca76fb, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:35.749430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925c95e-b569-4516-ada8-d326e72ce944 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:35.851696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:40:35 2022] PUT /identity/v3/projects/554f93838c5e42a988192b226de369c1/users/ea4f07147e4549bd81d0d408c5ca76fb/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:40:38.040528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac30-7376-46d0-a9e0-2dc482379003 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.041027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac30-7376-46d0-a9e0-2dc482379003 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.041027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac30-7376-46d0-a9e0-2dc482379003 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.042448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:38.048448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.048942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.049033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.065674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:38.066835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:38.128846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:38.152323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ac30-7376-46d0-a9e0-2dc482379003 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:38.268576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ac30-7376-46d0-a9e0-2dc482379003 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:38.299949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:38.300661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.300939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.301245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.311812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:38.319917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:38.321097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:38.322183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:38.327264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:38.421224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea710ca-7e6c-4e14-8890-9867610b8895 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:38.453593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:38.454824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.455104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.455386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.456125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:38.456433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:38.457821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:38.465637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:38.471420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:38.576360 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a214a-ee95-4855-bc5c-3fa7e9a79e9a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:38.613254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:38.614147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.614430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.614702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] PATH_INFO: `/v3/users/ea4f07147e4549bd81d0d408c5ca76fb` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.615894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] RBAC: Authorizing `identity:get_user(user_id=ea4f07147e4549bd81d0d408c5ca76fb)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:38.617371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:38.619018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:38 2022] GET /identity/v3/users/ea4f07147e4549bd81d0d408c5ca76fb => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:38.624805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:38.721854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ef904-28b7-4d72-acd6-c8c7605aaa9f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:38.756389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:38.757062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:38.757346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:38.757621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:38.822541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:38.823988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:38.918282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:38.925061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:39.020870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bd4bf-2427-4d0e-82ae-68195f1d6727 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:39.051957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:39.052803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:39.053111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:39.053391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] PATH_INFO: `/v3/projects/554f93838c5e42a988192b226de369c1` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:39.054562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] RBAC: Authorizing `identity:get_project(project_id=554f93838c5e42a988192b226de369c1)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:39.055978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58015-a04a-498b-823b-02b3abb04bcc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:39.057702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:38 2022] GET /identity/v3/projects/554f93838c5e42a988192b226de369c1 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:39.064453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:39.155671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e273-7b41-46e0-b487-9feba6aa7424 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:39.187321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:39.187900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:39.188768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:39.189100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:39.190040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=554f93838c5e42a988192b226de369c1, user.id=ea4f07147e4549bd81d0d408c5ca76fb) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:39.190348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:39.191764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c6415-9091-4c7a-9bf5-5d2ba837daa3 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:39.197346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:39 2022] GET /identity/v3/role_assignments?user.id=ea4f07147e4549bd81d0d408c5ca76fb&scope.project.id=554f93838c5e42a988192b226de369c1&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:41.407291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664218-4acc-4173-aa29-c6d9f1b8e60a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:41.407889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664218-4acc-4173-aa29-c6d9f1b8e60a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:41.407889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664218-4acc-4173-aa29-c6d9f1b8e60a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:41.409319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:41.414480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:41.414899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:41.415050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:41.432130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:41.433413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:41.496521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:41.519549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664218-4acc-4173-aa29-c6d9f1b8e60a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:41.620129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664218-4acc-4173-aa29-c6d9f1b8e60a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:41.651805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:41.652430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:41.652710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:41.652983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:41.715179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:41.716626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:41.808424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:41.814730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:41.908518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711496b9-89c8-451e-a5ba-42c5699a0d2f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:41.949972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:41.950990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:41.951379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:41.951764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:41.960059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:41.961712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-06d42883-a08b-465e-8127-73b94b40b32c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:41.976394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:41.977722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:41.978586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:40:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:41.983609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:42.076237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc1ce7-65e0-4804-97fa-cf4b8515d147 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:42.108080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:42.108729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:42.109014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:42.109319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:42.110168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:42.110549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:42.111907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d3034-ab63-4198-8527-17ff9a54eddc None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:42.118893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 11 12:40:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:44.401262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ded7-936a-47fb-abdb-4522e304f94b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:44.401799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ded7-936a-47fb-abdb-4522e304f94b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:44.402011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ded7-936a-47fb-abdb-4522e304f94b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:44.403400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:44.409660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc01f3-32af-4ee2-ac97-2f21426e87ab None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:44.410158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc01f3-32af-4ee2-ac97-2f21426e87ab None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:44.410262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc01f3-32af-4ee2-ac97-2f21426e87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:44.428290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f2fc01f3-32af-4ee2-ac97-2f21426e87ab None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:44.429529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f2fc01f3-32af-4ee2-ac97-2f21426e87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:44.495335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:44.526195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ded7-936a-47fb-abdb-4522e304f94b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:44.633381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ded7-936a-47fb-abdb-4522e304f94b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:44.665169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:44.665756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:44.666035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:44.666304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:44.667030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:44.668387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819ccda-f7d0-4a33-bdcb-7ec1d99adac4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:44.778908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed May 11 12:40:44 2022] POST /identity/v3/domains => generated 267 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:47.014834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0370-964c-441a-bb8f-7b81c16f88dc None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:47.015377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0370-964c-441a-bb8f-7b81c16f88dc None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:47.015377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0370-964c-441a-bb8f-7b81c16f88dc None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:47.017447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:47.023147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:47.023548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:47.023696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:47.040390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:47.041580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:47.104161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:47.127302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c0370-964c-441a-bb8f-7b81c16f88dc None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:47.223077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c0370-964c-441a-bb8f-7b81c16f88dc None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:47.254920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:47.255763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:47.256047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:47.256323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] PATH_INFO: `/v3/domains/e410dbb3a17449c490c730f877ac5043` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:47.267034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e410dbb3a17449c490c730f877ac5043)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:47.268425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c9f61-9061-4a8c-914c-213c24e04ae6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:47.270095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed May 11 12:40:47 2022] GET /identity/v3/domains/e410dbb3a17449c490c730f877ac5043 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:47.276870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:47.382309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06574df4-554f-47c1-b242-25cfda0feb38 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:47.414785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:47.415493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:47.415775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:47.416049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:47.416743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:47.418285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a21ce-1f12-43a8-b99e-f1c939d65529 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:47.526864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:40:47 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:49.768416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e107e-dc04-4009-bfcb-2af7c81df164 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:49.768928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e107e-dc04-4009-bfcb-2af7c81df164 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:49.769029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e107e-dc04-4009-bfcb-2af7c81df164 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:49.770386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:49.775562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:49.775975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:49.776120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:49.792360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:49.793563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:49.856209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:49.881754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e107e-dc04-4009-bfcb-2af7c81df164 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:49.976852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e107e-dc04-4009-bfcb-2af7c81df164 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:50.008519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:50.009647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:50.009928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:50.010199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] PATH_INFO: `/v3/domains/e410dbb3a17449c490c730f877ac5043` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:50.011361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e410dbb3a17449c490c730f877ac5043)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:50.012781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219f553-0225-4c22-8c55-d130ad157a36 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:50.014417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed May 11 12:40:49 2022] GET /identity/v3/domains/e410dbb3a17449c490c730f877ac5043 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:50.020032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:50.112360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6786e1-b0ad-4511-96fe-5ed4053866a4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:50.144512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:50.145200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:50.145484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:50.145756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:50.146463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:50.147880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e9d16-704d-4901-9b1c-7e44639cf763 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:50.241122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:40:50 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:40:52.494221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cec1-97eb-4cab-94f8-c6b622faaa35 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:52.494749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cec1-97eb-4cab-94f8-c6b622faaa35 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:52.494749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cec1-97eb-4cab-94f8-c6b622faaa35 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:52.496146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:52.501966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:52.502391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:52.502520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:52.519718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:52.520903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:52.584439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:52.607411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160cec1-97eb-4cab-94f8-c6b622faaa35 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:52.703724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160cec1-97eb-4cab-94f8-c6b622faaa35 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:52.734859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:52.735647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:52.735931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:52.736201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:52.746214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:52.754106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:52.755194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:52.756234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:52.761460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:52.857114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f0a3e-4cf5-4829-9614-d505fc3621ae None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:52.890551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:52.891227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:52.891505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:52.891778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:52.892508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:52.892809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:52.894203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:52.901839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:52.907598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:52.999500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5e842-1ff0-45fb-8ec9-4c7e9cd92925 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:53.031865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:53.032720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:53.033001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:53.033303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] PATH_INFO: `/v3/users/ec44338c2aba4232b28e0d37ed593723` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:53.045550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] RBAC: Authorizing `identity:get_user(user_id=ec44338c2aba4232b28e0d37ed593723)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:53.047684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:53.049461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:52 2022] GET /identity/v3/users/ec44338c2aba4232b28e0d37ed593723 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:53.055305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:53.149671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5c12-382b-4357-8e96-2e3981b6ebe4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:53.180808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:53.181470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:53.181753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:53.182026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:53.245718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:53.247149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:53.341731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:53.347961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:53.442266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717607ad-b89c-4ce8-a329-1f14601a1571 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:53.473860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:53.474678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:53.474960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:53.475235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] PATH_INFO: `/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:53.476387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] RBAC: Authorizing `identity:get_project(project_id=23e0a08bfd6e4c11892d96e9c76b32ab)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:53.477857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794f16a-7382-4dfe-b02c-2ed87e3d91b8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:53.479536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:53 2022] GET /identity/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:53.485644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:53.579692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5be9f-c14b-4905-a334-9c399eb170ee None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:53.615495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:53.616120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:53.617273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:53.617570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:53.618416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=23e0a08bfd6e4c11892d96e9c76b32ab, user.id=ec44338c2aba4232b28e0d37ed593723) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:53.618741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:53.620186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bc7e9-195e-44b0-accc-829dec622662 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:53.627389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:53 2022] GET /identity/v3/role_assignments?user.id=ec44338c2aba4232b28e0d37ed593723&scope.project.id=23e0a08bfd6e4c11892d96e9c76b32ab&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:40:55.809738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322df87-6390-4744-9c4e-9d34b7cd81e6 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:55.810240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322df87-6390-4744-9c4e-9d34b7cd81e6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:55.810348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322df87-6390-4744-9c4e-9d34b7cd81e6 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:55.811715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:55.817092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:55.817465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:55.817649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:55.834324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:55.835497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:55.898836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:40:55.922081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322df87-6390-4744-9c4e-9d34b7cd81e6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:56.016374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322df87-6390-4744-9c4e-9d34b7cd81e6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:56.047970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:56.048730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:56.049007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:56.049309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:56.058748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:56.066246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:56.067342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:40:56.068207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:56.073329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:56.167311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e01a0-060f-4ca1-8431-24570f53a8f7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:56.199723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:56.200378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:56.200663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:56.200941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:56.201719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:56.202029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:56.203606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:56.211376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:56.216965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:56.309547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed220c9-2066-4f87-9e00-50fd0d945165 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:56.339872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:56.340711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:56.340984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:56.341279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] PATH_INFO: `/v3/users/ec44338c2aba4232b28e0d37ed593723` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:56.342425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] RBAC: Authorizing `identity:get_user(user_id=ec44338c2aba4232b28e0d37ed593723)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:56.344586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:56.346231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:56 2022] GET /identity/v3/users/ec44338c2aba4232b28e0d37ed593723 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:56.351760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:56.446535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be70346-33c9-4375-9222-a2d5eda5fb4a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:56.477933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:56.478776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:56.479062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:56.479335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] PATH_INFO: `/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:56.480494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=23e0a08bfd6e4c11892d96e9c76b32ab)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:56.481951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f41a7-933f-4724-98e0-b45870ce9fd7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:56.483629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:56 2022] GET /identity/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:56.489898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:56.584238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddc33c-aa3c-47e8-8d05-6c20495db39e None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:56.623439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:56.624315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:56.624692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:56.625972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] PATH_INFO: `/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab/users/ec44338c2aba4232b28e0d37ed593723/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:56.627924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=23e0a08bfd6e4c11892d96e9c76b32ab, user_id=ec44338c2aba4232b28e0d37ed593723, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:56.629382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa35d-b8b3-42dd-9256-b4f264bb0df3 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:56.708876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:40:56 2022] PUT /identity/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab/users/ec44338c2aba4232b28e0d37ed593723/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:40:58.892032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834f3d-e4b1-433d-8c54-f6cec36d5c72 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:58.892572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834f3d-e4b1-433d-8c54-f6cec36d5c72 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:58.892672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834f3d-e4b1-433d-8c54-f6cec36d5c72 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:58.894145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:40:58.899441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:58.899850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:58.900003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:58.917816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:40:58.918999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:40:58.981014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:40:59.005093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834f3d-e4b1-433d-8c54-f6cec36d5c72 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.108431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834f3d-e4b1-433d-8c54-f6cec36d5c72 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.139413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.140705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.140983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.141284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.151222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:40:59.159358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:40:59.160430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:40:59.161642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:40:59.166530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.258279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27166daa-b849-423a-ab6e-e8e659383c35 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.290376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.291027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.291307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.291577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.292308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:59.292612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:59.294000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:59.301973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:59.307537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.400954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8605-efa8-4cf0-8664-14e46048e3b9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.432547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.433536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.433821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.434123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] PATH_INFO: `/v3/users/ec44338c2aba4232b28e0d37ed593723` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.435291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] RBAC: Authorizing `identity:get_user(user_id=ec44338c2aba4232b28e0d37ed593723)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:59.436714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:59.438964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/users/ec44338c2aba4232b28e0d37ed593723 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:59.444574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.537915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a81120-3a10-4675-a244-956d5cc1a0b7 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.569079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.569726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.570010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.570285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.634016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:59.635749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:59.727264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:40:59.732988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.828566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518b96-6327-4047-8fd0-26281b526a29 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.860594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.861462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.861747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.862020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] PATH_INFO: `/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.863180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] RBAC: Authorizing `identity:get_project(project_id=23e0a08bfd6e4c11892d96e9c76b32ab)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:59.864601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed93a0a-a124-4c97-8244-d0cddd700965 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:40:59.866306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/projects/23e0a08bfd6e4c11892d96e9c76b32ab => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:40:59.872260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:40:59.964199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad937226-9851-4ac1-adc8-60edc90b5a60 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:40:59.995626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:40:59.996255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:40:59.996532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:40:59.996803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:40:59.997644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=23e0a08bfd6e4c11892d96e9c76b32ab, user.id=ec44338c2aba4232b28e0d37ed593723) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:40:59.997950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:40:59.999902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dc032-9839-400f-a041-3c7bfc03c7e6 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:41:00.005415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:40:59 2022] GET /identity/v3/role_assignments?user.id=ec44338c2aba4232b28e0d37ed593723&scope.project.id=23e0a08bfd6e4c11892d96e9c76b32ab&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:17.505123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb12f79-e2d9-4d68-b274-571394415745 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:17.505723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb12f79-e2d9-4d68-b274-571394415745 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:17.505723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb12f79-e2d9-4d68-b274-571394415745 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:17.507037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:17.512947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:17.514200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:17.514200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:17.532518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:17.533816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:17.599577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:17.626790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb12f79-e2d9-4d68-b274-571394415745 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:17.725379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb12f79-e2d9-4d68-b274-571394415745 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:17.757225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403388ee-77f2-4272-8623-54879366787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:17.757947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403388ee-77f2-4272-8623-54879366787c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:17.758228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403388ee-77f2-4272-8623-54879366787c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:17.758500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403388ee-77f2-4272-8623-54879366787c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:17.768708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403388ee-77f2-4272-8623-54879366787c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:17.770178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403388ee-77f2-4272-8623-54879366787c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-403388ee-77f2-4272-8623-54879366787c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:17.788636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:17.789758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:17.790736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:17.790736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:17.790736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:17.790736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:17.790736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:17.796176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:17.892633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ae2be-4dfe-47a8-9a89-501587f38359 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:17.924691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:17.925374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:17.925659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:17.925933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:17.926643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:17.926948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:17.928329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a3621-1aed-43f4-9175-0b4f1957c534 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:17.939570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:17.945304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403388ee-77f2-4272-8623-54879366787c None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:18.042797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403388ee-77f2-4272-8623-54879366787c None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:18.074781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:18.075467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:18.076351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:18.076645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:18.077335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:18.078756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08328a3-853d-44f0-b13a-53b8abcf240e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:18.170921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 11 12:42:17 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:42:20.428532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d968-7052-42e9-b293-58c3bd0ee3b5 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:20.429109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d968-7052-42e9-b293-58c3bd0ee3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:20.429109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1d968-7052-42e9-b293-58c3bd0ee3b5 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:20.430489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:20.436498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:20.436880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:20.437072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:20.460147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:20.461388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:20.527199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:20.550744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1d968-7052-42e9-b293-58c3bd0ee3b5 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:20.649165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1d968-7052-42e9-b293-58c3bd0ee3b5 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:20.681686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:20.682398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:20.682676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:20.682947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:20.694488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:20.702383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:20.704021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:20.704912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:20.709654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:20.818683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca069a-88bb-4f5e-971d-661257d4ee42 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:20.851829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:20.852504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:20.852787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:20.853090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:20.853832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:20.854143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:20.855507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:20.863940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:20.869573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:20.964260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f574446-b3ec-41c8-8502-079ccb42991d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:20.997562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:20.998395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:20.998684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:20.998952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.008979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.010451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:21.027107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:21.028152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:21.030326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:21.030326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:21.030326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:21.030326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:21.030326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:21.034659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:21.133133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1e94-dc9f-436b-b652-97ef9b298aad None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:21.167425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:21.168112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:21.168397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:21.168669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.170035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:21.170340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.171705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.183201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:21.189173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:21.285823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27036b4-8f81-4752-ba03-5eeb9de0f3a0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:21.317942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:21.318729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:21.319010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:21.319283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.327438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.328911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:21.343751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:21.344940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:21.345927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:21.350833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:21.446195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067ae29-f041-47a8-b27f-0d47a436b3d4 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:21.480094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:21.480751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:21.481032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:21.481332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.482486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:21.482810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.484445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.501335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:21.506871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:21.605256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10627ed4-40ed-46a4-bde2-4100c41abcaf None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:21.637402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:21.638054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:21.638913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:21.639194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.702939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.704406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.811183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:42:21.816914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:21.912388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c594c-0a72-4d29-bb26-c07767a96726 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:21.944922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:21.945738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:21.946018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:21.946284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:21.956233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:21.957739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:21.975076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:21.976139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:21.977087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:21.977087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:21.977087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:21.977087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:21.977087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:21.982771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:22.076245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7da709-376b-4d7e-b7cc-6b4a46f498b0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:22.108872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:22.112653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:22.123604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:22.129129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:22.225240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c0c7a-5cdf-460a-8573-dadbb837243d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:22.257424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:22.258212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:22.258790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:22.259068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:22.266033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:22.267460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:22.281280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:22.282954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:22.284796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:22.288679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:22.384998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ef2c9-a49b-45bc-aa1b-6cdb226288a8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:22.420030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:22.420678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:22.420962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:22.421256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:22.422016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:22.422323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:22.423740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3604ed-3949-41f3-80cc-09a45c9ca598 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:22.435358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:22.441577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:22.539015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039c9bd-0b26-47fd-8029-7e242d6107ff None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:22.570696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:22.571339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:22.571620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:22.571892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:22.572702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=23d5c01936db49eea09a70c2c5852238) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:22.573010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:22.574447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8cfa4-1721-4534-838f-fb69cae6f922 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:22.580072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:42:22 2022] GET /identity/v3/role_assignments?user.id=23d5c01936db49eea09a70c2c5852238&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:24.781019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089508c6-dbb6-4280-b68c-7e0f02ff9bf9 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:24.781617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089508c6-dbb6-4280-b68c-7e0f02ff9bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:24.781617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089508c6-dbb6-4280-b68c-7e0f02ff9bf9 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:24.782976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:24.788191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:24.788613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:24.788751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:24.805413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:24.806596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:24.869937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:24.893801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089508c6-dbb6-4280-b68c-7e0f02ff9bf9 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:24.989671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089508c6-dbb6-4280-b68c-7e0f02ff9bf9 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.022957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.023733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.024160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.024450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.034481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:25.042291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:25.044699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:25.045780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:25.050209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.145899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4d62-562e-48b0-999a-c4864b4f8567 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.178023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.178680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.178957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.179228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.179956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] RBAC: Adding query filter params (name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:25.180258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.181689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.189305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:25.195385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.291863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c96668-20a4-428c-918e-de4ccb7acbc6 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.323560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.324344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.324627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.324903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.336403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.337835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:25.355741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:25.356877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:25.358005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:25.358005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:25.358005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:25.358005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:25.358005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:25.364330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.461849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12800-85c7-42f4-9d85-301c535c524a None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.493884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.494546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.494832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.495214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.495930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:25.496237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.498463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.510244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:25.516756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.617711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187a13-328c-413f-b022-532c25a41573 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.650167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.650965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.651249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.651525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] PATH_INFO: `/v3/users/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.659210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.660649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:25.675173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:25.676362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:25.677574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:25.682181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.778331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d10d9-416e-4998-9d10-68e28d362df1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.811490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.812194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.812424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.812690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.813626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:25.813931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.815362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.832465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:25.838163 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:25.933082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a224-5cf2-4b76-a529-24aef3fb2bea None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:25.965324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:25.966718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:25.967151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:25.967524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:25.977583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:25.982836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:25.995373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:25.996568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:25.997750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:25.997750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:25.997750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:25.997750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:25.997750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:26.002222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:26.097778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0c89e-796b-449f-a9fb-5c74643898bb None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:26.131978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:26.132719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:26.133010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:26.133330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:26.134308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:26.134616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:26.135990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:26.153769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:26.159650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:26.255445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc79b0-10d0-442a-aefd-de42464da864 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:26.287565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:26.288342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:26.288629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:26.288905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:26.295487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:26.296932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:26.311739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:26.312811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:26.313945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:26.318936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:26.421798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46a95f-d3e3-4faa-be35-29dbca00f526 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:26.468341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:26.469007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:26.469305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:26.469578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:26.470356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:26.470661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:26.472087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0431dee-93e4-4bf0-95ee-a6ca6b08a569 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:26.484245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:26.490204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:26.592019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa286af-018f-4ff2-bab2-82ffa848e365 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:26.628642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:26.629545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:26.629825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:26.630093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/23d5c01936db49eea09a70c2c5852238/roles/1540809a33644471a8393b7bae9bcf45` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:26.644362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=23d5c01936db49eea09a70c2c5852238, role_id=1540809a33644471a8393b7bae9bcf45)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:26.645816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8262bf-ceb4-4829-8314-e0544b67b555 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:26.753248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:42:26 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/23d5c01936db49eea09a70c2c5852238/roles/1540809a33644471a8393b7bae9bcf45 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:42:28.952191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ae9f-23fb-43cd-b80d-5a21faa243fd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:28.952702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ae9f-23fb-43cd-b80d-5a21faa243fd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:28.952702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50ae9f-23fb-43cd-b80d-5a21faa243fd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:28.954160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:28.959531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:28.959946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:28.960079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:28.976766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:28.977999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:29.041023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:42:29.064921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50ae9f-23fb-43cd-b80d-5a21faa243fd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.161325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50ae9f-23fb-43cd-b80d-5a21faa243fd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.194763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.195556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.195837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.196108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.206624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:29.214251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:29.221824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:29.222723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:29.223405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.315175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c956e-2b96-4da9-ace8-18363e974df6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.346522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.347183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.347461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.347735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.348475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] RBAC: Adding query filter params (name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:29.348780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:29.350171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:29.358410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:29.364108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.460412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1e82-55c8-4b92-93da-ab7b801d8051 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.493197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.493982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.494264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.494536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.504641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:29.506108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:29.523794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:29.524919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:29.525875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:29.525875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:29.525875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:29.525875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:29.525875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:29.531480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.629505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ac285-53d4-468a-a79e-5237b495ad3d None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.662902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.663566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.663885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.664167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.664929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:29.665231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:29.666597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:29.677684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:29.683347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.782975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21844-47a8-40e8-bb71-91ff0d2fdec9 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.815449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.816257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.816533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.816808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.824134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:29.826270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:29.840141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:29.841864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:29.843183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:29.847921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:29.944139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce71b70-812c-4694-ac60-006758fc9a4a None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:29.975872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:29.976535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:29.976817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:29.977126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:29.977951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:29.978261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:29.979683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:29.997034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:30.002872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:30.097177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a266c-6d24-48d8-be57-7778829eef1d None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:30.130517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:30.131350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:30.131636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:30.131910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:30.197982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:30.199437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:30.292581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:42:30.299066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:30.393761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320b4f7-6b54-442e-aed7-e890d743f4fe None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:30.427087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:30.427866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:30.428150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:30.428425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:30.438274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:30.442746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:30.456707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:30.457813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:30.458878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:30.458878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:30.458878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:30.458878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:30.458878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:30.463698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:30.558855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cce0c7-5a5b-4fb5-934b-f0161c4c0ae5 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:30.592678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:30.593369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:30.593645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:30.593912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:30.594617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:30.594923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:30.596336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:30.607724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:30.613378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:30.708991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d235-6b16-4b2a-8d1d-231ac9e2a852 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:30.742696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:30.743482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:30.743766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:30.744040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:30.750497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:30.756356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:30.765941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:30.766964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:30.768125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:30.774004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:30.870081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffe14a-408d-4a4c-9d0d-2d4ce564e805 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:30.902359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f477-a966-4415-b660-368c0368349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:30.903006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f477-a966-4415-b660-368c0368349c None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:30.903290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f477-a966-4415-b660-368c0368349c None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:30.903724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f477-a966-4415-b660-368c0368349c None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:30.904746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f477-a966-4415-b660-368c0368349c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:30.905079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f477-a966-4415-b660-368c0368349c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:30.906603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1f477-a966-4415-b660-368c0368349c None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:30.918509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:30.925382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:31.021111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0b8c-c974-45e8-a6ee-d48ff4277cf8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:31.053629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:31.054269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:31.054554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:31.054831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:31.055699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] RBAC: Adding query filter params (role.id=1540809a33644471a8393b7bae9bcf45, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=23d5c01936db49eea09a70c2c5852238) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:31.056010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:31.057466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4ef9-3c6d-47f6-8021-983466610b17 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:31.063241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:42:30 2022] GET /identity/v3/role_assignments?user.id=23d5c01936db49eea09a70c2c5852238&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=1540809a33644471a8393b7bae9bcf45 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:33.335931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefca5c-4fe3-4c73-9952-6eb56462de89 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:33.336494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefca5c-4fe3-4c73-9952-6eb56462de89 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:33.336494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefca5c-4fe3-4c73-9952-6eb56462de89 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:33.337898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:33.343998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:33.344505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:33.344646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:33.361882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:33.363083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:33.429536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:33.452855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefca5c-4fe3-4c73-9952-6eb56462de89 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:33.551259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefca5c-4fe3-4c73-9952-6eb56462de89 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:33.585339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:33.586192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:33.586421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:33.586696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:33.597151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:33.604781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:33.605922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:33.607679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:33.612828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:33.707219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3b53-5134-4aff-a704-2a5f99b2f623 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:33.740177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:33.740863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:33.741174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:33.741451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:33.742192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:33.742500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:33.743869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:33.751688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:33.757648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:33.856279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27f6b3-93d9-4524-89c2-8e6f6b2390bc None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:33.889167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:33.889951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:33.890236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:33.890512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:33.900634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:33.905529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:33.920470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:33.921596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:33.922631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:33.922631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:33.922631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:33.922631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:33.922631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:33.927636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.023238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbec725-1fad-4071-bd15-f25fc90b3bce None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.055288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.055944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.056222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.056493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.057233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:34.057535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.058979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.070955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:34.077217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.174385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737ff1-36c7-4b49-a8b2-1319067f7222 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.207304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.208095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.208374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.208645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.215819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.217380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:34.231150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:34.232250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:34.233441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:34.238345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.333247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55de2b9-137c-4306-938c-c28f56dea0f8 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.365316 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.365991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.366255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.366528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.367348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:34.367652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.369103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.386929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:34.393399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.490223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453535b9-b302-4482-bc0b-87b9c3628467 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.523317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.523956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.524237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.524509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.589061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.590514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.686302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:42:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 12:42:34.692097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.787346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351230b1-b093-42d2-9e52-2a684ae55b14 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.820199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.820981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.821323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.821598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.831348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.832789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:34.850179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:34.853593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:34.854712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:34.854712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:34.854712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:34.854712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:34.854712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:34.857808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:34.951251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ad20-7417-47ca-843e-cff6228edb9e None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:34.984694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:34.985390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:34.985663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:34.985935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:34.986649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:34.986993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:34.988357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:34.999957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:35.005713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:35.099550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c59da-b6ad-4d32-8600-219c2d452cef None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:35.131999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:35.132778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:35.133133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:35.133406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:35.141096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:35.142524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:35.156825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:35.162661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:35.163698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:35.164273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:35.259457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b494b-226f-4dd6-b9df-38763dc22954 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:35.292097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:35.292780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:35.293085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:35.293466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:35.294276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:35.294585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:35.296016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365017-bfca-4c59-87ad-5258b5cbf0d5 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:35.307563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:35.313711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:35.409862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a5338-adfa-4d97-a5b7-9921d4a8a5b5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:35.440979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:35.441649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:35.441937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:35.442216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:35.443053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=23d5c01936db49eea09a70c2c5852238) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:35.443356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:35.444781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ecb1-b8b0-4d26-9a2e-35e6f826e757 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:35.450042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:42:35 2022] GET /identity/v3/role_assignments?user.id=23d5c01936db49eea09a70c2c5852238&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:37.720705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fd61-546f-46e9-a144-5b3d75365f52 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:37.721197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fd61-546f-46e9-a144-5b3d75365f52 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:37.721287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031fd61-546f-46e9-a144-5b3d75365f52 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:37.722773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:37.727919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:37.728330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:37.728479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:37.745925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:37.747148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:37.810936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:37.834425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031fd61-546f-46e9-a144-5b3d75365f52 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:37.932965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031fd61-546f-46e9-a144-5b3d75365f52 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:37.967346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:37.968171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:37.968455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:37.968729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:37.978486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:37.986805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:37.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:37.988924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:37.994084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.086510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06524-ca2b-4e37-a14e-c5e9435ae79d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.117929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.118579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.118859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.119162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.119895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:38.120202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.121608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.129929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:38.136010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.234240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b114-0f46-4166-a138-366cf8f2c872 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.266697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.267774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.268095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.268364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.279893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.300435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:38.301526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:38.303051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:38.304599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:38.304599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:38.304599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:38.304599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:38.304599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:38.309094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.405245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218776e7-cacf-442e-95d2-7889dbd487a9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.438129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.438778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.439059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.439332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.440131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:38.440438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.441839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.453979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:38.459831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.557393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00815-ceb4-4397-957b-763ea99307c2 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.590419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.591857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.592187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.592500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.599890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.601363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:38.615567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:38.616711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:38.617874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:38.623022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.720703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043c6-8b84-407a-aa97-b7a99390f701 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.753120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.753789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.754091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.754353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.755195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:38.755502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.756929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.774308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:38.780021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:38.890362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13bd51-957e-4f16-a68e-bc3f5ce9af48 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:38.924344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:38.925191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:38.925481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:38.925753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:38.936562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:38.938043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:38.955129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:38.956040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:38.958596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:38.958596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:38.958596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:38.958596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:38.958596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:38.962048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:39.058574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593829da-da9b-407d-9288-e3cd6899e0f2 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:39.091805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:39.092460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:39.092744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:39.093016 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:39.093755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:39.094056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:39.095402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:39.106128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:39.111817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:39.214156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8110be9-72a2-4cb4-9db2-e3db2d8a5695 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:39.246224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:39.247556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:39.247840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:39.248112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:39.254627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:39.256134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:39.271085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:39.272238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:39.277960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:39.278770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:39.373943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df4d14-7bfc-460e-8a3d-9f9e19d1ac92 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:39.405713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:39.406360 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:39.406644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:39.406917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:39.407693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:39.408004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:39.409468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97d78b-20c4-4811-91d7-89702117b338 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:39.421603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:39.427544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:39.528068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5b81-b143-419b-8c89-cc55245788a1 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:39.561978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:39.562856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:39.563139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:39.563412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] PATH_INFO: `/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/23d5c01936db49eea09a70c2c5852238/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:39.565351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad72030e9a4999bbd7aad0cba0d4b8, user_id=23d5c01936db49eea09a70c2c5852238, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:39.566888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afa9ad-e96e-47a1-bf67-66d8fdce773d None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:39.632091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 11 12:42:39 2022] PUT /identity/v3/projects/f6ad72030e9a4999bbd7aad0cba0d4b8/users/23d5c01936db49eea09a70c2c5852238/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:42:41.826456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56733ce-8167-40df-83a8-1e91c8f2f413 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:41.827004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56733ce-8167-40df-83a8-1e91c8f2f413 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:41.827004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56733ce-8167-40df-83a8-1e91c8f2f413 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:41.828376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:41.834099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:41.834564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:41.834679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:41.854416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:41.855623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:41.922883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:41.946487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56733ce-8167-40df-83a8-1e91c8f2f413 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.044552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56733ce-8167-40df-83a8-1e91c8f2f413 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.077888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.079794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.079794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.079794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.088865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 12:42:42.096816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:42.098002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:42.099039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 11 12:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:42.104004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.201831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be953-9a89-45a4-b332-0f58b184c895 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.242922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.243586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.243945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.244219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.244953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:42.245283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:42.246676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:42.254829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:42.260816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.355401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ddcff-2623-49f6-8407-03f1ae2340c0 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.388121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.388899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.389210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.389486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.399500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:42.403961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:42.424218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:42.425460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:42.426527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:42.426527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:42.426527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:42.426527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:42.426527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:42.431450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.531797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45095c1d-5e24-4e6f-8320-e7216d283590 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.562729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.563382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.563659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.563929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.564632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:42.564934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:42.566336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:42.578201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:42.584026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.680863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb013f-97bd-4e63-b177-ea6f9fd91234 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.715028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.715859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.716143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.716418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.724148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:42.725621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 12:42:42.739488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:42.740552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:42.741653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:42.746663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:42.844164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226df4c0-6806-44b5-82c8-180e6ca129ed None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:42.877174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:42.877845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:42.878130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:42.878407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:42.879228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:42.879539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:42.880960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:42.898429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:42.904305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.000734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b0e2-39f0-48e5-99b4-966bc5130703 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.033771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.034405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.034690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.034967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.102924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.104288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.197171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 11 12:42:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 12:42:43.203734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.299302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a384b-2d72-4fd1-a47c-0a715e26e6f7 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.331982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.332763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.333185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.333461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.343388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.344872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 12:42:43.362297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:43.363312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:43.364600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 12:42:43.364600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 12:42:43.364600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 12:42:43.364600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:43.364600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:43.369066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.463836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901d042-cfd8-41b2-babc-1cbb09e727ab None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.496420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.497176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.497602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.497881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.498592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:43.498897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.500266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.511353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 11 12:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:43.517276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.622873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46f722-b258-4e3e-a82d-8887af3aeb2f None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.662050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.662933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.663216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.663491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.670890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.672332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 12:42:43.685953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application with Lock( May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:43.687080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: ERROR keystone.server.flask.application May 11 12:42:43.688107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 11 12:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:43.694669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.789631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69e481-b2ce-4f38-bdb9-295feaf46ae5 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.824747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.825973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.826262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.826540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.827327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:43.827632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.829100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2add1a5-1507-45b0-aabe-d2045e551569 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.840803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 11 12:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:43.847644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:43.947677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc284a-66df-415c-8f7d-4a3ad2e51ce0 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:43.980345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:43.981083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:43.981371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:43.981768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:43.982593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] RBAC: Adding query filter params (role.id=e3e67a5ff9c548a99cfb439bbde0e7d9, scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8, user.id=23d5c01936db49eea09a70c2c5852238) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:43.982907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:43.984340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d600ba-038e-476f-ace1-47e1528e0cfa None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:43.990092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 11 12:42:43 2022] GET /identity/v3/role_assignments?user.id=23d5c01936db49eea09a70c2c5852238&scope.project.id=f6ad72030e9a4999bbd7aad0cba0d4b8&role.id=e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:46.271177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5e75-27b4-40be-b4d2-6b77e5d5ba4a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:46.271776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5e75-27b4-40be-b4d2-6b77e5d5ba4a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:46.271776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5e75-27b4-40be-b4d2-6b77e5d5ba4a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:46.273144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:46.278792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:46.278792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:46.279251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:46.299460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:46.301769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:46.377632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 12:42:46.401769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5e75-27b4-40be-b4d2-6b77e5d5ba4a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:46.514216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5e75-27b4-40be-b4d2-6b77e5d5ba4a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:46.550353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:46.551071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:46.551357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:46.551634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:46.552292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:46.553691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:46.567932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:46.569329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:46.570988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:46.578349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:46.675870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf4210-99a1-48ab-b45e-faa54546cde7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:46.710118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:46.710783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:46.711064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:46.711335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:46.712030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:46.712392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:46.713776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccf98f-4e69-4a11-996a-f185cb54c047 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:46.718718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 11 12:42:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:46.724642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:46.822783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b49dcd-ccf0-4069-99a8-e6242bd99764 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:46.854077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:46.854733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:46.855012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:46.855285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] PATH_INFO: `/v3/services` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:46.855981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:46.856812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:46.858209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd63c70-0d6a-4836-be44-429c8657ece5 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:46.862630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 11 12:42:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:49.063564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226a35-86cb-4fbb-bbe7-8674bf230aec None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:49.064068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226a35-86cb-4fbb-bbe7-8674bf230aec None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:49.064068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1226a35-86cb-4fbb-bbe7-8674bf230aec None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:49.065484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:49.070763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a60435-cf4e-4a49-aa99-0f3d8106ccb4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:49.071145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a60435-cf4e-4a49-aa99-0f3d8106ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:49.071348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a60435-cf4e-4a49-aa99-0f3d8106ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:49.088830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-45a60435-cf4e-4a49-aa99-0f3d8106ccb4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:49.090034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-45a60435-cf4e-4a49-aa99-0f3d8106ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:49.155045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:49.178321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1226a35-86cb-4fbb-bbe7-8674bf230aec None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:49.276686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1226a35-86cb-4fbb-bbe7-8674bf230aec None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:49.309969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:49.310628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:49.310908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:49.311184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:49.311892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:49.313295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f8005-40a5-4b34-b0b0-30b817e00f78 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:49.382219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 11 12:42:49 2022] POST /identity/v3/services => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:42:51.618751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b352-afc1-4ab3-b979-72e762ddc79a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:51.619319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b352-afc1-4ab3-b979-72e762ddc79a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:51.619319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b352-afc1-4ab3-b979-72e762ddc79a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:51.620696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:51.626239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:51.626644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:51.626824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:51.645431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:51.649868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:51.718879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:51.742696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b352-afc1-4ab3-b979-72e762ddc79a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:51.841319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b352-afc1-4ab3-b979-72e762ddc79a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:51.874403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:51.875122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:51.875405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:51.875677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:51.876353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:51.877755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:51.889465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:51.891038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:51.892171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:42:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:51.896827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:51.993065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d49bb-63a5-4a19-8c7c-da02ea787482 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:52.025324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:52.025983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:52.026267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:52.026538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:52.027221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:52.027521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:52.029567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:52.034553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 11 12:42:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:52.040469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:52.134924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27717231-c3c5-40f6-9153-4506eaa02df9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:52.166964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:52.167954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:52.167954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:52.168164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:52.168949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] RBAC: Adding query filter params (interface=public, service_id=7b86575592cb4fa294c86e219f1d655b, region_id=RegionOne) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:52.169455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:52.170831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51030-6cc2-4588-8f28-88b7c34983a9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:52.175712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 11 12:42:52 2022] GET /identity/v3/endpoints?service_id=7b86575592cb4fa294c86e219f1d655b&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:42:52.181404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:52.276936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd671f-c432-4b3b-be73-0a9eea446e14 None admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:52.309574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:52.310336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:52.310662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:52.310941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:52.311618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:52.312977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed5680-498f-4b35-af46-e0c08d8d40af None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:52.319788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 11 12:42:52 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:42:54.549233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe142d-e730-4479-bcea-4f0a1b0bbc5a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:54.549810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe142d-e730-4479-bcea-4f0a1b0bbc5a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:54.549810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe142d-e730-4479-bcea-4f0a1b0bbc5a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:54.551175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:42:54.556298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:54.556732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:54.557268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:54.576530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:42:54.577749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:42:54.648360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:42:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 12:42:54.672530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe142d-e730-4479-bcea-4f0a1b0bbc5a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:54.771987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe142d-e730-4479-bcea-4f0a1b0bbc5a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:54.804215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:54.804972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:54.805280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:54.805551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:54.806190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:54.807675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 12:42:54.820087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 12:42:54.824811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.get_or_create( May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application with Lock( May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self._enter() May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application return self.creator() May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application created_value = creator( May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: ERROR keystone.server.flask.application May 11 12:42:54.826076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 11 12:42:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 12:42:54.827761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:54.926287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1723155-dc0e-427d-b5ae-3140d13ac883 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:54.959556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:54.960217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:54.960502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:54.960779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] PATH_INFO: `/v3/services` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:54.961515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:42:54.961826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:54.963194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6282c0-127d-4c77-8eba-ec2b86243382 None admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:54.968280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 11 12:42:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:42:54.974183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:42:55.068909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c080f50-e493-4579-b505-bf15805fcfa9 None admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:42:55.100580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:42:55.101302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:42:55.101586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:42:55.101858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:42:55.102592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:42:55.104027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11608a34-76b8-4c71-b87a-bb853a7b3252 None admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:42:55.193822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 11 12:42:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:49:35.120782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fe0e-a40b-45f7-8c9e-1fe4bc803be7 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:35.122077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fe0e-a40b-45f7-8c9e-1fe4bc803be7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:35.122591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2fe0e-a40b-45f7-8c9e-1fe4bc803be7 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:35.130562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546fe0-8ebe-4a7d-83d3-523d043b99fb None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:35.131475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546fe0-8ebe-4a7d-83d3-523d043b99fb None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:35.131960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546fe0-8ebe-4a7d-83d3-523d043b99fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:35.135547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:35.214285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0a546fe0-8ebe-4a7d-83d3-523d043b99fb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:35.215887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0a546fe0-8ebe-4a7d-83d3-523d043b99fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:35.385320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:35.429700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:35.430127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:35.431024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:35.433364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 964 bytes} [Wed May 11 12:49:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:35.440736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9710-1951-42df-93e8-763721b17ffc None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:35.441056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9710-1951-42df-93e8-763721b17ffc None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:35.441792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea9710-1951-42df-93e8-763721b17ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:35.566646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5cea9710-1951-42df-93e8-763721b17ffc None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:35.568177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5cea9710-1951-42df-93e8-763721b17ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:35.654602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Wed May 11 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:35.661696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:35.663617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:35.775969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67cc7-e058-48a5-9bb0-334393593b4c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:35.849368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:35.850214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:35.850601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:35.850978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:35.852722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:35.968118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:35.969888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97f116-20f6-4b04-9d8f-d9e67e4c205b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:35.990574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:38.586217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:38.586783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:38.586783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:38.594853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a708-91d1-4f3c-a21c-2fd7188bbc21 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:38.594853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a708-91d1-4f3c-a21c-2fd7188bbc21 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:38.594853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3a708-91d1-4f3c-a21c-2fd7188bbc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:38.598060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:38.679588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-43a3a708-91d1-4f3c-a21c-2fd7188bbc21 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:38.680818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-43a3a708-91d1-4f3c-a21c-2fd7188bbc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:38.791260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:38.831395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:38.832928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:38.942020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f2b60-e2de-493f-a6e2-abc69561a7ce None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:39.019394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:39.020133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:39.020519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:39.020895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:39.023005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:39.145477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:39.147081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d52594-e6ef-4d21-892e-e7044cf2f513 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:39.167046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 658/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:41.895326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:41.895845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:41.895940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:41.897316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 657/1315] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:41.902621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fccaff-4a0e-4bc8-b74e-6344554e6585 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:41.903019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fccaff-4a0e-4bc8-b74e-6344554e6585 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:41.903172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fccaff-4a0e-4bc8-b74e-6344554e6585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:41.964369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-24fccaff-4a0e-4bc8-b74e-6344554e6585 None None] MFA Rules not processed for user `fd24ac751a004d07a90e60d34f0abc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:41.965532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-24fccaff-4a0e-4bc8-b74e-6344554e6585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:42.058175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 659/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:42.097684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:42.099232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:42.198409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cd506-bf8a-4e79-bc78-e2867ca3ec4a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:42.269624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:42.270241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:42.270525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:42.270802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:42.272476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:42.380182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:42.381667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805e6b2-e2cb-4e56-bb56-ff9510052d13 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:42.399218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 658/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:45.380223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:45.380767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:45.380767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:45.382208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 660/1318] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:45.387352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84cdcf-1ae2-42ed-ad24-84013739b7b8 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:45.387724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84cdcf-1ae2-42ed-ad24-84013739b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:45.387917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84cdcf-1ae2-42ed-ad24-84013739b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:45.449611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4c84cdcf-1ae2-42ed-ad24-84013739b7b8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:45.450793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4c84cdcf-1ae2-42ed-ad24-84013739b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:45.542705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 659/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:49:45.580585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:45.582287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:45.680518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbe544-6f76-4f54-acdf-a414f66e22e6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:45.752732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:45.753402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:45.753687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:45.753961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:45.755579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:45.860259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:45.861766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9b07-6750-4b21-89cc-a704b69aa624 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:45.880816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 661/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:49.105929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4534a-ef8c-455d-aeb8-ff89fad2624b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:49.106529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4534a-ef8c-455d-aeb8-ff89fad2624b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:49.106529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd4534a-ef8c-455d-aeb8-ff89fad2624b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:49.107929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 660/1321] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:49.113626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb30bfe-b05a-47f0-8437-3a72dbaa6343 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:49.113626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb30bfe-b05a-47f0-8437-3a72dbaa6343 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:49.114634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb30bfe-b05a-47f0-8437-3a72dbaa6343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:49.176663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-bcb30bfe-b05a-47f0-8437-3a72dbaa6343 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:49.177894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bcb30bfe-b05a-47f0-8437-3a72dbaa6343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:49.271545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 662/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:49:49.321234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:49.321542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:49.321815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:49.323211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 964 bytes} [Wed May 11 12:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:49.328935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568df99-1e9a-464a-8da4-2ca4b5b0eabd None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:49.329258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568df99-1e9a-464a-8da4-2ca4b5b0eabd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:49.329656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568df99-1e9a-464a-8da4-2ca4b5b0eabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:49.405715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4568df99-1e9a-464a-8da4-2ca4b5b0eabd None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:49.406887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4568df99-1e9a-464a-8da4-2ca4b5b0eabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:49.480329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1061 bytes} [Wed May 11 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:49.490351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:49.491875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:49.593088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ffa4-f952-4fc7-95e5-522e0b1614e7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:49.665156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:49.665735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:49.666022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:49.666299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:49.667940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:49.775212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:49.776741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48758301-fadd-482f-9b94-2f624e25b0a6 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:49.796759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:52.435029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:52.435628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:52.435628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:52.437235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:52.443462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655871-3fdf-41c5-b8c2-268727ce407f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:52.443958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655871-3fdf-41c5-b8c2-268727ce407f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:52.444083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a655871-3fdf-41c5-b8c2-268727ce407f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:52.521188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8a655871-3fdf-41c5-b8c2-268727ce407f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:52.522377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8a655871-3fdf-41c5-b8c2-268727ce407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:52.637856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:49:52.675290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:52.676843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:52.778674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f36ae-decb-4048-983b-fc66529e6773 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:52.850844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:52.851497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:52.851779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:52.852054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:52.853735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:52.961435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:52.962805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9ea1d-464b-4137-a23a-cb9a70d0fd9a service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:52.980140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:55.299800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:55.300345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:55.300345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:55.301775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:55.307109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153efb0-18cb-4cc1-8f7f-226553a10a39 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:55.307520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153efb0-18cb-4cc1-8f7f-226553a10a39 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:55.307667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153efb0-18cb-4cc1-8f7f-226553a10a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:55.371334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8153efb0-18cb-4cc1-8f7f-226553a10a39 None None] MFA Rules not processed for user `fd24ac751a004d07a90e60d34f0abc75`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:55.372538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8153efb0-18cb-4cc1-8f7f-226553a10a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:55.477626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:49:55.514617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:55.516209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:55.616637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51bc3-2618-492a-989b-9a4391a94aaf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:55.687811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:55.688475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:55.689351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:55.689809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:55.691470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:55.796677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:55.798109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27db298-b1d3-446e-8cbc-20e6f154498c service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:55.816187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:49:58.671466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:58.672031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:58.672031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:58.673500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:49:58.679096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1bc-474a-42ba-a26c-2d1a9f2ee5b0 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:58.679613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1bc-474a-42ba-a26c-2d1a9f2ee5b0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:58.679718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1bc-474a-42ba-a26c-2d1a9f2ee5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:58.750889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a4c5b1bc-474a-42ba-a26c-2d1a9f2ee5b0 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:49:58.752209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a4c5b1bc-474a-42ba-a26c-2d1a9f2ee5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:58.850197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:49:58.886431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:49:58.887989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:58.990201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e0438-c720-4acd-9f57-db4bffc00492 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:49:59.060719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:49:59.061300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:49:59.061588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:49:59.061857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:49:59.063480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:49:59.169384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:49:59.170810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa00d18-d808-4428-9d43-217c95c68abd service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:49:59.190318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:01.514798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:01.515307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:01.515307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:01.516723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:01.522187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60658c49-0b1d-4442-af6f-b15ccd3defef None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:01.522617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60658c49-0b1d-4442-af6f-b15ccd3defef None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:01.522738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60658c49-0b1d-4442-af6f-b15ccd3defef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:01.589834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-60658c49-0b1d-4442-af6f-b15ccd3defef None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:01.591056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-60658c49-0b1d-4442-af6f-b15ccd3defef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:01.684082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:01.723936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:01.725514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:01.825402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab9680-f090-429b-a67c-84af79dd9ebe None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:01.898289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:01.898941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:01.899226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:01.899498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:01.901147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:02.004722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:02.006181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3dee-41ee-4aca-9b0a-62e0ef2c5223 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:02.024105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:04.756444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:04.756976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:04.756976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:04.758379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:04.763444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f915-1aaa-4665-a68b-f0053055d283 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:04.764245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f915-1aaa-4665-a68b-f0053055d283 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:04.764245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f915-1aaa-4665-a68b-f0053055d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:04.827218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d926f915-1aaa-4665-a68b-f0053055d283 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:04.828409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d926f915-1aaa-4665-a68b-f0053055d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:04.925926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:04.962800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:04.964307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:05.065941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ce19e-9d62-4efb-a61f-dbad3db4e932 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:05.137495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:05.138152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:05.138439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:05.138717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:05.142144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:05.253160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:05.254652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9976e-b8da-4505-8251-30f681d9e330 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:05.272585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:09.713156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:09.713646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:09.713752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:09.715107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:09.721219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f90f-e6c9-4404-9cc2-bcfd8018af76 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:09.721650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f90f-e6c9-4404-9cc2-bcfd8018af76 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:09.721907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f90f-e6c9-4404-9cc2-bcfd8018af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:09.790445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b533f90f-e6c9-4404-9cc2-bcfd8018af76 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:09.791897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b533f90f-e6c9-4404-9cc2-bcfd8018af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:09.895341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:50:09.933594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:09.935677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:10.033015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456634e-dcea-4a24-8aa2-4755484ca056 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:10.036590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:10.037272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:10.037558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:10.037834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:10.046499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:10.047903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1dee-620f-482c-a3f9-de4cbc491e1b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:10.057202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:13.284106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe01c5-668e-4735-9384-fd4a13d54b20 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:13.284596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe01c5-668e-4735-9384-fd4a13d54b20 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:13.284788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe01c5-668e-4735-9384-fd4a13d54b20 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:13.286323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:13.291586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfacb9-f364-4332-b845-ac0647428188 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:13.292004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfacb9-f364-4332-b845-ac0647428188 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:13.292149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfacb9-f364-4332-b845-ac0647428188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:13.321327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-eacfacb9-f364-4332-b845-ac0647428188 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:13.322519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-eacfacb9-f364-4332-b845-ac0647428188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:13.415641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:13.452561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe01c5-668e-4735-9384-fd4a13d54b20 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:13.463082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe01c5-668e-4735-9384-fd4a13d54b20 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:13.466660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:13.467386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:13.467671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:13.467945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:13.477352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:13.478777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb360909-7276-4866-b730-a784a971e99c service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:13.488627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:17.991867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:17.992366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:17.992366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:17.993775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:17.998929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a066abc-e103-46ec-8e00-727b26279c5f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:17.999337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a066abc-e103-46ec-8e00-727b26279c5f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:17.999486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a066abc-e103-46ec-8e00-727b26279c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:18.018519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2a066abc-e103-46ec-8e00-727b26279c5f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:18.019696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2a066abc-e103-46ec-8e00-727b26279c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:18.027822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:18.064707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:18.066513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:18.080025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae3e49-5e45-4c24-a737-df6e6a426490 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:18.083618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:18.084250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:18.084534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:18.084815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:18.093756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:18.095305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811658-0639-4db2-ae58-a3cd03879382 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:18.104538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:23.591983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0e40-f197-4fa2-81e7-4ce1ed01d79b None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:23.592807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0e40-f197-4fa2-81e7-4ce1ed01d79b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:23.592807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0e40-f197-4fa2-81e7-4ce1ed01d79b None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:23.594984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:23.599896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e177-6359-479c-a0d6-ecf6f9d330d5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:23.600700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e177-6359-479c-a0d6-ecf6f9d330d5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:23.601163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54e177-6359-479c-a0d6-ecf6f9d330d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:23.680582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5a54e177-6359-479c-a0d6-ecf6f9d330d5 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:23.682102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5a54e177-6359-479c-a0d6-ecf6f9d330d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:23.766220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:27.938369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490ebb-2baa-476a-90b7-41816f1c62fd None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:27.938884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490ebb-2baa-476a-90b7-41816f1c62fd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:27.939210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58490ebb-2baa-476a-90b7-41816f1c62fd None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:27.940722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:27.945959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1d2f-2aae-48d5-8d84-15aa7d82f5c9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:27.946853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1d2f-2aae-48d5-8d84-15aa7d82f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:27.947309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1d2f-2aae-48d5-8d84-15aa7d82f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:27.966590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-234a1d2f-2aae-48d5-8d84-15aa7d82f5c9 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:27.967996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-234a1d2f-2aae-48d5-8d84-15aa7d82f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:27.977845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:50:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:29.644743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408876b-aa14-496f-bb2e-47bcc6ab5f61 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:29.645288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408876b-aa14-496f-bb2e-47bcc6ab5f61 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:29.645288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408876b-aa14-496f-bb2e-47bcc6ab5f61 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:29.646684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:29.651686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590770e-5b04-4e86-a9ae-b22cf992ab87 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:29.652151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590770e-5b04-4e86-a9ae-b22cf992ab87 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:29.652254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590770e-5b04-4e86-a9ae-b22cf992ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:29.670705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d590770e-5b04-4e86-a9ae-b22cf992ab87 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:29.671956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d590770e-5b04-4e86-a9ae-b22cf992ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:29.680482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:33.712533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a594e-2c5d-41b9-ba6e-4bc69950ca1f None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:33.713364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a594e-2c5d-41b9-ba6e-4bc69950ca1f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:33.713819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a594e-2c5d-41b9-ba6e-4bc69950ca1f None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:33.719509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:33.720999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d72c-100b-4abb-a335-d5d208b80369 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:33.721662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d72c-100b-4abb-a335-d5d208b80369 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:33.721948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191d72c-100b-4abb-a335-d5d208b80369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:33.741555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5191d72c-100b-4abb-a335-d5d208b80369 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:33.742757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5191d72c-100b-4abb-a335-d5d208b80369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:33.757111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:33.808168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224227b-3189-4eb5-a808-b2ffe1e06d3c None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:33.808168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224227b-3189-4eb5-a808-b2ffe1e06d3c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:33.808168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224227b-3189-4eb5-a808-b2ffe1e06d3c None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:33.808168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 11 12:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:33.810231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cc24-490a-4f9e-a02b-fa2fb3b4476f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:33.810595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cc24-490a-4f9e-a02b-fa2fb3b4476f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:33.810946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6cc24-490a-4f9e-a02b-fa2fb3b4476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:33.862609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ced6cc24-490a-4f9e-a02b-fa2fb3b4476f None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:33.863800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ced6cc24-490a-4f9e-a02b-fa2fb3b4476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:33.943743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 11 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:33.951944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224227b-3189-4eb5-a808-b2ffe1e06d3c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:33.966800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224227b-3189-4eb5-a808-b2ffe1e06d3c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:33.972832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:33.973502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:33.973791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:33.974099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:33.981968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:33.983601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ed188-e45b-4695-bd39-3b191d9ba7a0 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:33.993726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:36.502072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454ca4-47da-4208-9bcf-51da825f11e5 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:36.502621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454ca4-47da-4208-9bcf-51da825f11e5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:36.502621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1454ca4-47da-4208-9bcf-51da825f11e5 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:36.504016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:36.509559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d50c-1d20-45e3-b60f-f0b500be0671 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:36.509968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d50c-1d20-45e3-b60f-f0b500be0671 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:36.510049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d50c-1d20-45e3-b60f-f0b500be0671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:36.528831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3a12d50c-1d20-45e3-b60f-f0b500be0671 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:36.530219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3a12d50c-1d20-45e3-b60f-f0b500be0671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:36.538808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:36.584647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1454ca4-47da-4208-9bcf-51da825f11e5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:36.600888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1454ca4-47da-4208-9bcf-51da825f11e5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:36.606478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:36.607145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:36.607426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:36.607697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:36.617407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:36.618992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8286f-6eb7-4f01-a378-3b9f7fb1da10 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:36.629113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:39.371652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ee23-8520-485e-9241-0222510ad453 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:39.371652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ee23-8520-485e-9241-0222510ad453 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:39.371652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ee23-8520-485e-9241-0222510ad453 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:39.371652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:39.376870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03a68-b922-4527-bdbc-9509b865622e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:39.377278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03a68-b922-4527-bdbc-9509b865622e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:39.377476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03a68-b922-4527-bdbc-9509b865622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:39.395752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a2f03a68-b922-4527-bdbc-9509b865622e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:39.396941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a2f03a68-b922-4527-bdbc-9509b865622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:39.404847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:39.451881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35515d-d427-4a91-84e3-7937776ae585 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:39.452287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35515d-d427-4a91-84e3-7937776ae585 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:39.453225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35515d-d427-4a91-84e3-7937776ae585 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:39.454758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 11 12:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:39.460009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999126-0f18-4774-91a4-735c5b03bcdf None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:39.460441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999126-0f18-4774-91a4-735c5b03bcdf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:39.460745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2999126-0f18-4774-91a4-735c5b03bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:39.479046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a2999126-0f18-4774-91a4-735c5b03bcdf None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:39.480286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a2999126-0f18-4774-91a4-735c5b03bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:39.490248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 11 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:50:39.497728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35515d-d427-4a91-84e3-7937776ae585 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:39.512021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35515d-d427-4a91-84e3-7937776ae585 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:39.517884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:39.518512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:39.518796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:39.519071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:39.527082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:39.531446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cdccc-76b0-44bc-ba56-cd75f25d46e9 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:39.538435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:50:42.019077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4f26-8fb8-494c-b984-16c8bb353022 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.019582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4f26-8fb8-494c-b984-16c8bb353022 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.019582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee4f26-8fb8-494c-b984-16c8bb353022 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.020930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:42.026592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4cee-7f75-4987-9a41-d3759ca65c54 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.027064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4cee-7f75-4987-9a41-d3759ca65c54 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.027357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc4cee-7f75-4987-9a41-d3759ca65c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.046981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7ebc4cee-7f75-4987-9a41-d3759ca65c54 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:42.048340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7ebc4cee-7f75-4987-9a41-d3759ca65c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:42.056508 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:42.071765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d049-c126-4254-913c-574439089630 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.072055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d049-c126-4254-913c-574439089630 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.072503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d049-c126-4254-913c-574439089630 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.074092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 685/1371] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:42.080545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fe5f-46b1-40f5-b7e7-64bbffb6587e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.081011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fe5f-46b1-40f5-b7e7-64bbffb6587e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.081425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2fe5f-46b1-40f5-b7e7-64bbffb6587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.101382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d049-c126-4254-913c-574439089630 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:42.103168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b5c2fe5f-46b1-40f5-b7e7-64bbffb6587e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:42.104519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b5c2fe5f-46b1-40f5-b7e7-64bbffb6587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:42.114400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 687/1372] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:50:42.118047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d049-c126-4254-913c-574439089630 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:42.124105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:42.125337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.125837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.126305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.135744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:42.137746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47b458-b806-43e7-9d16-50761c8ebde3 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:42.149742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 686/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:42.448960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159674-b05d-420b-89a6-fee10bcf3b91 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.449329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159674-b05d-420b-89a6-fee10bcf3b91 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.449618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6159674-b05d-420b-89a6-fee10bcf3b91 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.451254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 688/1374] 10.222.0.49 () {54 vars in 963 bytes} [Wed May 11 12:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:42.456739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686369-14b4-4757-a729-9bded5b6abbe None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.457146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686369-14b4-4757-a729-9bded5b6abbe None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.457374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686369-14b4-4757-a729-9bded5b6abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.510414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f8686369-14b4-4757-a729-9bded5b6abbe None None] MFA Rules not processed for user `eee618b771c149d98b108e389c511acf`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:42.511757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f8686369-14b4-4757-a729-9bded5b6abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:42.572758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 687/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Wed May 11 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:42.580358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159674-b05d-420b-89a6-fee10bcf3b91 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:42.591235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6159674-b05d-420b-89a6-fee10bcf3b91 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:42.595483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:42.596230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:42.596616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:42.596991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:42.606280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:42.607815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d512543-2ff7-4c72-939c-654f9cf3c8fa service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:42.618209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 689/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:44.514157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b76-399b-41fb-b0c2-f0cb0ee68041 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:44.514722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b76-399b-41fb-b0c2-f0cb0ee68041 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:44.514873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1982b76-399b-41fb-b0c2-f0cb0ee68041 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:44.516263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 688/1377] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:44.521682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce794-3ba3-4196-bf99-3d39ca0ce73d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:44.522104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce794-3ba3-4196-bf99-3d39ca0ce73d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:44.522239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efce794-3ba3-4196-bf99-3d39ca0ce73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:44.540057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5efce794-3ba3-4196-bf99-3d39ca0ce73d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:44.541321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5efce794-3ba3-4196-bf99-3d39ca0ce73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:44.549898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 690/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:44.594181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982b76-399b-41fb-b0c2-f0cb0ee68041 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:44.609424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1982b76-399b-41fb-b0c2-f0cb0ee68041 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:44.615075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:44.615726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:44.616010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:44.616882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:44.625629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:44.627246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce48e6-b96a-4d6e-bea0-22c36ca9b68a service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:44.640128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 689/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:47.146910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a01233-7ec8-4439-9ca8-bf608310280e None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:47.147439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a01233-7ec8-4439-9ca8-bf608310280e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:47.147523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a01233-7ec8-4439-9ca8-bf608310280e None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:47.148861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 691/1380] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:47.154256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f279d0-4bb8-4d8f-8e06-2c2d2af2c76e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:47.154660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f279d0-4bb8-4d8f-8e06-2c2d2af2c76e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:47.154809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f279d0-4bb8-4d8f-8e06-2c2d2af2c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:47.174346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-41f279d0-4bb8-4d8f-8e06-2c2d2af2c76e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:47.175534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-41f279d0-4bb8-4d8f-8e06-2c2d2af2c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:47.183849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 690/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:47.227362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a01233-7ec8-4439-9ca8-bf608310280e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:47.241974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a01233-7ec8-4439-9ca8-bf608310280e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:47.247382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:47.248049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:47.248338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:47.248618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:47.256895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:47.258509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c882e6-461c-4677-90e7-1a70e366c506 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:47.268619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 692/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:49.672335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a17a-fad6-4746-a0c4-b59fcd7e112a None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:49.672899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a17a-fad6-4746-a0c4-b59fcd7e112a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:49.672899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980a17a-fad6-4746-a0c4-b59fcd7e112a None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:49.674617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 691/1383] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:49.679910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df9f6-9064-4c3e-882b-07816e2b3d5b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:49.680380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df9f6-9064-4c3e-882b-07816e2b3d5b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:49.680464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df9f6-9064-4c3e-882b-07816e2b3d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:49.702937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-6c5df9f6-9064-4c3e-882b-07816e2b3d5b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:49.703786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6c5df9f6-9064-4c3e-882b-07816e2b3d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:49.712114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 693/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:49.762339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980a17a-fad6-4746-a0c4-b59fcd7e112a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:49.779120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980a17a-fad6-4746-a0c4-b59fcd7e112a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:49.785816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:49.786457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:49.786737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:49.787008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:49.800862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:49.802618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0b23-dd24-400b-a588-cda97ba836e7 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:49.815342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 692/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:52.207849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924109c4-ed2a-4179-b308-b0dc746f4a37 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:52.208454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924109c4-ed2a-4179-b308-b0dc746f4a37 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:52.208842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924109c4-ed2a-4179-b308-b0dc746f4a37 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:52.210406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 694/1386] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:52.216331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a482a5-9344-4a40-9c56-e0650a6cba65 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:52.216823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a482a5-9344-4a40-9c56-e0650a6cba65 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:52.216927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a482a5-9344-4a40-9c56-e0650a6cba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:52.237345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-99a482a5-9344-4a40-9c56-e0650a6cba65 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:52.239044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-99a482a5-9344-4a40-9c56-e0650a6cba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:52.247959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 693/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:50:52.297701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924109c4-ed2a-4179-b308-b0dc746f4a37 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:52.312975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924109c4-ed2a-4179-b308-b0dc746f4a37 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:52.319300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:52.320373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:52.320789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:52.321117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:52.333799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:52.335791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fac52-361e-405f-897c-e3cb85ad4664 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:52.353310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 695/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:50:55.185716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522aaa7-b325-4578-93be-869402823f49 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:55.186716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522aaa7-b325-4578-93be-869402823f49 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:55.186716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522aaa7-b325-4578-93be-869402823f49 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:55.187886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 694/1389] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:55.193862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09251-7212-4862-9611-13139440574e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:55.194377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09251-7212-4862-9611-13139440574e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:55.194571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c09251-7212-4862-9611-13139440574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:55.215386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f1c09251-7212-4862-9611-13139440574e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:55.216653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f1c09251-7212-4862-9611-13139440574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:55.225683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 696/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:55.273493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522aaa7-b325-4578-93be-869402823f49 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:55.289774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522aaa7-b325-4578-93be-869402823f49 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:55.295710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:55.296448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:55.296746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:55.297026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:55.306058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:55.307751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad6ec9-a853-44aa-9f4f-3d66d7705f2c service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:55.318468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 695/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:57.695188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435433fe-ed20-4f94-ba79-4c93e6fa2dff None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:57.695639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435433fe-ed20-4f94-ba79-4c93e6fa2dff None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:57.695744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435433fe-ed20-4f94-ba79-4c93e6fa2dff None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:57.697148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 697/1392] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:57.702749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2fc79-6112-42aa-8bcb-91109c71fad1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:57.703282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2fc79-6112-42aa-8bcb-91109c71fad1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:57.703623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2fc79-6112-42aa-8bcb-91109c71fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:57.722295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-51d2fc79-6112-42aa-8bcb-91109c71fad1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:57.723465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-51d2fc79-6112-42aa-8bcb-91109c71fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:57.731414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 696/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:57.775612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435433fe-ed20-4f94-ba79-4c93e6fa2dff None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:57.790760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435433fe-ed20-4f94-ba79-4c93e6fa2dff None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:57.796936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:57.797604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:57.797891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:57.798169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:57.806674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:57.810157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ac006-2204-44ac-bf55-2db3da38b12d service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:57.819347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 698/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:58.660657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5f69-02fa-4b78-8875-13f0b6c366fd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:58.660947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5f69-02fa-4b78-8875-13f0b6c366fd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:58.661263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5f69-02fa-4b78-8875-13f0b6c366fd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:58.662784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 697/1395] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:58.668338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d6d-7156-4088-888c-bab919d0c746 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:58.668631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d6d-7156-4088-888c-bab919d0c746 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:58.668911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c34d6d-7156-4088-888c-bab919d0c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:58.687010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-41c34d6d-7156-4088-888c-bab919d0c746 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:58.688204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-41c34d6d-7156-4088-888c-bab919d0c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:58.696049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 699/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:58.756507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0339-574a-4c8b-b752-73f428384d86 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:58.756977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0339-574a-4c8b-b752-73f428384d86 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:58.757131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb0339-574a-4c8b-b752-73f428384d86 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:58.758715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 698/1397] 10.222.0.49 () {54 vars in 962 bytes} [Wed May 11 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:58.763596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4890a2-a34f-470d-a609-c685236c07f8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:58.764649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4890a2-a34f-470d-a609-c685236c07f8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:58.764929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4890a2-a34f-470d-a609-c685236c07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:58.814685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9a4890a2-a34f-470d-a609-c685236c07f8 None None] MFA Rules not processed for user `752019a13ba44236ba1c1e13aea6129d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:58.815887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9a4890a2-a34f-470d-a609-c685236c07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:58.874914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 700/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Wed May 11 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:58.882307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb0339-574a-4c8b-b752-73f428384d86 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:58.893001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb0339-574a-4c8b-b752-73f428384d86 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:58.896855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:58.897584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:58.897935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:58.898276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:58.907211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:58.908700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b8612-9503-4052-b8aa-2351b01b4972 service glance] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:58.918026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 699/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:50:59.548519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125e90-ad41-4f63-80fa-17996c37aeb6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:59.549416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125e90-ad41-4f63-80fa-17996c37aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:59.549416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6125e90-ad41-4f63-80fa-17996c37aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:59.597252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b6125e90-ad41-4f63-80fa-17996c37aeb6 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:59.598460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b6125e90-ad41-4f63-80fa-17996c37aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:59.661376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 701/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:59.707686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c179e77-72b7-4309-b15a-36274f3cccaf None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:59.708052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c179e77-72b7-4309-b15a-36274f3cccaf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:59.708395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c179e77-72b7-4309-b15a-36274f3cccaf None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:59.710060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 700/1401] 10.222.0.49 () {54 vars in 942 bytes} [Wed May 11 12:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:50:59.716241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf8e5-3e28-4f5d-a61d-a3b69fabb5c4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:59.716709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf8e5-3e28-4f5d-a61d-a3b69fabb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:59.716801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf8e5-3e28-4f5d-a61d-a3b69fabb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:59.765819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0c1cf8e5-3e28-4f5d-a61d-a3b69fabb5c4 None None] MFA Rules not processed for user `4584309e6ee74080b5b3bc63eacdab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:50:59.767055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0c1cf8e5-3e28-4f5d-a61d-a3b69fabb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:50:59.856077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 702/1402] 10.222.0.49 () {58 vars in 1039 bytes} [Wed May 11 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:50:59.868300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c179e77-72b7-4309-b15a-36274f3cccaf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:50:59.885335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c179e77-72b7-4309-b15a-36274f3cccaf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:50:59.890701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:50:59.891346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:50:59.891637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:50:59.891948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:50:59.900163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:50:59.901775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60904f-a224-4210-99a1-37f75381629e service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:50:59.910208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 701/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 12:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 12:51:00.226820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fceb-6431-48de-bac5-201b51033de7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:00.227114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fceb-6431-48de-bac5-201b51033de7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:00.227419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fceb-6431-48de-bac5-201b51033de7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:00.228858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 703/1404] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:00.234919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9126fb-8c16-46e0-8883-a892324806f9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:00.235210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9126fb-8c16-46e0-8883-a892324806f9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:00.235537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9126fb-8c16-46e0-8883-a892324806f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:00.253816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6e9126fb-8c16-46e0-8883-a892324806f9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:00.259386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6e9126fb-8c16-46e0-8883-a892324806f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:00.262775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 702/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:00.312889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435fceb-6431-48de-bac5-201b51033de7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:00.330172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435fceb-6431-48de-bac5-201b51033de7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:00.336320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:00.338591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:00.338591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:00.338591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:00.348748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:00.350569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1509b5c-8212-432c-8368-267d9ac0b8a9 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:00.360410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 704/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:02.812423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afe3-fbf3-41ed-ba04-0b24624928e1 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:02.812985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afe3-fbf3-41ed-ba04-0b24624928e1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:02.812985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4afe3-fbf3-41ed-ba04-0b24624928e1 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:02.814392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 703/1407] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:02.819622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6d51b-2e16-44ac-8161-9d5cba708a48 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:02.820066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6d51b-2e16-44ac-8161-9d5cba708a48 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:02.820171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6d51b-2e16-44ac-8161-9d5cba708a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:02.840485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-59f6d51b-2e16-44ac-8161-9d5cba708a48 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:02.841777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-59f6d51b-2e16-44ac-8161-9d5cba708a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:02.858011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 705/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:02.894382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4afe3-fbf3-41ed-ba04-0b24624928e1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:02.911307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4afe3-fbf3-41ed-ba04-0b24624928e1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:02.916844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:02.917518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:02.917805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:02.918080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:02.927355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:02.928945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02dea1-2b4a-47fb-8d68-e7bdd5ca5142 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:02.941210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 704/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:24.094532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567546f-3eb5-440e-ab9e-d2ab18216ec3 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:24.095159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567546f-3eb5-440e-ab9e-d2ab18216ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:24.095159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567546f-3eb5-440e-ab9e-d2ab18216ec3 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:24.096501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 706/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed May 11 12:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:24.102228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d00a5-3ef8-418f-8a74-34596fce7407 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:24.102753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d00a5-3ef8-418f-8a74-34596fce7407 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:24.102877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d00a5-3ef8-418f-8a74-34596fce7407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:24.121944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-627d00a5-3ef8-418f-8a74-34596fce7407 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:24.124189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-627d00a5-3ef8-418f-8a74-34596fce7407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:24.132660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 705/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 11 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:24.147342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85aeaf-4c33-4556-9392-9bee7aaaacae None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:24.147632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85aeaf-4c33-4556-9392-9bee7aaaacae None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:24.147913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85aeaf-4c33-4556-9392-9bee7aaaacae None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:24.149329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 707/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed May 11 12:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:24.154192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94f4-07f3-4d0f-bb30-c2c935618222 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:24.154690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94f4-07f3-4d0f-bb30-c2c935618222 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:24.155033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94f4-07f3-4d0f-bb30-c2c935618222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:24.173352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-255b94f4-07f3-4d0f-bb30-c2c935618222 None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:24.174518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-255b94f4-07f3-4d0f-bb30-c2c935618222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:24.183407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 706/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 11 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:26.908742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ad8-845d-4b75-bc35-3f173c7fabb2 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:26.909307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ad8-845d-4b75-bc35-3f173c7fabb2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:26.909429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ad8-845d-4b75-bc35-3f173c7fabb2 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:26.910731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:26.916070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1a4c-c317-49ca-bbe1-c6c8c2738e0f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:26.916499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1a4c-c317-49ca-bbe1-c6c8c2738e0f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:26.916608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1a4c-c317-49ca-bbe1-c6c8c2738e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:26.934436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2ded1a4c-c317-49ca-bbe1-c6c8c2738e0f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:26.935603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2ded1a4c-c317-49ca-bbe1-c6c8c2738e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:26.943383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:26.984822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76ad8-845d-4b75-bc35-3f173c7fabb2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:26.998945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76ad8-845d-4b75-bc35-3f173c7fabb2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:27.004392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:27.005023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:27.005341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:27.005619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:27.013706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:27.015541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43157-dfa4-4b0d-86e3-4473b2ddaa15 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:27.024804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 709/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:28.015987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89dd-d3d8-46a0-9c73-7a13f46101b5 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:28.016515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89dd-d3d8-46a0-9c73-7a13f46101b5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:28.016515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89dd-d3d8-46a0-9c73-7a13f46101b5 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:28.017871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:28.022753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765c0f-d400-4da2-9af6-84cf59acdb3a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:28.023158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765c0f-d400-4da2-9af6-84cf59acdb3a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:28.023308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06765c0f-d400-4da2-9af6-84cf59acdb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:28.041551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-06765c0f-d400-4da2-9af6-84cf59acdb3a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:28.042734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-06765c0f-d400-4da2-9af6-84cf59acdb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:28.050551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:28.237428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc89dd-d3d8-46a0-9c73-7a13f46101b5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:28.251875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc89dd-d3d8-46a0-9c73-7a13f46101b5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:28.257344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:28.257987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:28.258269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:28.258545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:28.267792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:28.269349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1fe3-6201-4ee2-867f-79c63ffc9d0a service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:28.278492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 709/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:29.226949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02e6b-73bd-4c3e-b055-3b4606594df5 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:29.227518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02e6b-73bd-4c3e-b055-3b4606594df5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:29.227518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b02e6b-73bd-4c3e-b055-3b4606594df5 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:29.228882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:29.233793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195300b-3e10-4a4a-97d6-9d0dce44a5a2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:29.234186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195300b-3e10-4a4a-97d6-9d0dce44a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:29.234354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195300b-3e10-4a4a-97d6-9d0dce44a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:29.252326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5195300b-3e10-4a4a-97d6-9d0dce44a5a2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:29.253556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5195300b-3e10-4a4a-97d6-9d0dce44a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:29.261292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:29.413195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b02e6b-73bd-4c3e-b055-3b4606594df5 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:29.427103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b02e6b-73bd-4c3e-b055-3b4606594df5 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:29.432461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:29.433122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:29.433411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:29.433688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:29.441935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:29.446239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fd148-828c-482a-906d-0c5d0cd82a86 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:29.453131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 712/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:30.381231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9bcc-35a1-41e1-8682-02e56fb62943 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:30.381839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9bcc-35a1-41e1-8682-02e56fb62943 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:30.381839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9bcc-35a1-41e1-8682-02e56fb62943 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:30.383191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:30.388036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8b4af-a043-4bc3-9413-dca7c17d912c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:30.388491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8b4af-a043-4bc3-9413-dca7c17d912c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:30.388624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8b4af-a043-4bc3-9413-dca7c17d912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:30.406436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-08e8b4af-a043-4bc3-9413-dca7c17d912c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:30.407632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-08e8b4af-a043-4bc3-9413-dca7c17d912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:30.415362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:30.563410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9bcc-35a1-41e1-8682-02e56fb62943 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:30.577628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9bcc-35a1-41e1-8682-02e56fb62943 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:30.582964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:30.583587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:30.583867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:30.584135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:30.593113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:30.594681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f47d18-8687-48e4-a556-411ec3e00fd2 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:30.603734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 712/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:31.570954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5cad2-1625-4ae1-958f-f1c74490681e None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:31.571477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5cad2-1625-4ae1-958f-f1c74490681e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:31.571477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5cad2-1625-4ae1-958f-f1c74490681e None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:31.572820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:31.578580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9983-bcac-48e8-950f-d069b6e0bb7d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:31.578964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9983-bcac-48e8-950f-d069b6e0bb7d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:31.579133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df9983-bcac-48e8-950f-d069b6e0bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:31.596689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e0df9983-bcac-48e8-950f-d069b6e0bb7d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:31.597935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e0df9983-bcac-48e8-950f-d069b6e0bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:31.605723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:31.755626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5cad2-1625-4ae1-958f-f1c74490681e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:31.770460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5cad2-1625-4ae1-958f-f1c74490681e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:31.775975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:31.776605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:31.776918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:31.777231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:31.786214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:31.787875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1523b-330f-4dad-8d8f-8b216be90cbc service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:31.797280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 715/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:32.785441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461ed2c-7dc7-4c46-890f-f83174c850e1 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:32.786017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461ed2c-7dc7-4c46-890f-f83174c850e1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:32.786017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461ed2c-7dc7-4c46-890f-f83174c850e1 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:32.787383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:32.792465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b6487-7a54-49b8-a06f-4f35de6e6ab9 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:32.792872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b6487-7a54-49b8-a06f-4f35de6e6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:32.793158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b6487-7a54-49b8-a06f-4f35de6e6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:32.812161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-332b6487-7a54-49b8-a06f-4f35de6e6ab9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:32.813438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-332b6487-7a54-49b8-a06f-4f35de6e6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:32.821172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:32.970396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461ed2c-7dc7-4c46-890f-f83174c850e1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:32.985185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461ed2c-7dc7-4c46-890f-f83174c850e1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:32.990604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:32.991245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:32.991527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:32.991801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:32.999953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:33.001555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10e394-49b1-4470-9345-6459ef580463 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:33.010468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 715/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:33.983555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9750-5ab1-4a5d-bdfe-82ca254fb5ce None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:33.984105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9750-5ab1-4a5d-bdfe-82ca254fb5ce None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:33.984105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb9750-5ab1-4a5d-bdfe-82ca254fb5ce None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:33.985468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:51:33.990269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c56e-babe-44b2-a2bc-e7c73cfa979e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:33.990669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c56e-babe-44b2-a2bc-e7c73cfa979e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:33.990817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c56e-babe-44b2-a2bc-e7c73cfa979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:34.009610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-22a2c56e-babe-44b2-a2bc-e7c73cfa979e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:34.010801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-22a2c56e-babe-44b2-a2bc-e7c73cfa979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:34.019475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:34.168204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9750-5ab1-4a5d-bdfe-82ca254fb5ce None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:34.183123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb9750-5ab1-4a5d-bdfe-82ca254fb5ce None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:34.189332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:34.189963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:34.190250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:34.190529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:34.198493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:34.200327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba860d-7605-404b-b05f-42f0d448b25b service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:34.209532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 718/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:35.158429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c44c8-124d-41cb-87ea-bc2c0f0efbda None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:35.158967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c44c8-124d-41cb-87ea-bc2c0f0efbda None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:35.158967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c44c8-124d-41cb-87ea-bc2c0f0efbda None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:35.160373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:35.165311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91103-eb79-42df-a835-be49924ae109 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:35.165723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91103-eb79-42df-a835-be49924ae109 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:35.165862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b91103-eb79-42df-a835-be49924ae109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:35.185307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-68b91103-eb79-42df-a835-be49924ae109 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:35.187322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-68b91103-eb79-42df-a835-be49924ae109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:35.195647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:35.346627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c44c8-124d-41cb-87ea-bc2c0f0efbda None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:35.361022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c44c8-124d-41cb-87ea-bc2c0f0efbda None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:35.366370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:35.366998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:35.367281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:35.367556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:35.376055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:35.377667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef79d8-f809-4fb9-8c3a-c02250baa5b1 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:35.386767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 718/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:36.360307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2271d-6ac7-483c-95e9-75e2a34cef11 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:36.360876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2271d-6ac7-483c-95e9-75e2a34cef11 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:36.360876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2271d-6ac7-483c-95e9-75e2a34cef11 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:36.362274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:36.367291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440f43-7eb2-4938-b97a-056ff55e6cb4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:36.367670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440f43-7eb2-4938-b97a-056ff55e6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:36.367853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02440f43-7eb2-4938-b97a-056ff55e6cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:36.385935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-02440f43-7eb2-4938-b97a-056ff55e6cb4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:36.387141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-02440f43-7eb2-4938-b97a-056ff55e6cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:36.395135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:36.543296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2271d-6ac7-483c-95e9-75e2a34cef11 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:36.557610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2271d-6ac7-483c-95e9-75e2a34cef11 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:36.563818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:36.564455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:36.564741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:36.565018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:36.573126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:36.575305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6cfc7-2cc7-4652-a5a2-9fe752d9cfaf service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:36.584954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 721/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:38.693094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669975-af64-4a9e-9976-1a9ecda48d08 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:38.693505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669975-af64-4a9e-9976-1a9ecda48d08 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:38.693657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9669975-af64-4a9e-9976-1a9ecda48d08 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:38.695023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:38.701068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fffa-2847-40e4-9d36-06714fba9f7c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:38.701497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fffa-2847-40e4-9d36-06714fba9f7c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:38.701636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97fffa-2847-40e4-9d36-06714fba9f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:38.719860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2c97fffa-2847-40e4-9d36-06714fba9f7c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:38.721098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2c97fffa-2847-40e4-9d36-06714fba9f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:38.728915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:38.767872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9669975-af64-4a9e-9976-1a9ecda48d08 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:38.778466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9669975-af64-4a9e-9976-1a9ecda48d08 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:38.783199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:38.783199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:38.783199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:38.783199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:38.791694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:38.793139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3372368-385d-4e38-8b3f-255837e5baa8 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:38.802798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 721/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:41.267461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a85d8-1b64-413c-86dc-1b2ff0a6dc36 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:41.268013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a85d8-1b64-413c-86dc-1b2ff0a6dc36 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:41.268013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a85d8-1b64-413c-86dc-1b2ff0a6dc36 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:41.269514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:41.274694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb6ff-7abc-4dde-a183-58a23d50b88f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:41.275123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb6ff-7abc-4dde-a183-58a23d50b88f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:41.275253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4eb6ff-7abc-4dde-a183-58a23d50b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:41.292936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2c4eb6ff-7abc-4dde-a183-58a23d50b88f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:41.294734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2c4eb6ff-7abc-4dde-a183-58a23d50b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:41.302763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:41.340655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a85d8-1b64-413c-86dc-1b2ff0a6dc36 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:41.351200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a85d8-1b64-413c-86dc-1b2ff0a6dc36 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:41.354766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:41.355398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:41.355709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:41.355989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:41.365928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:41.367349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636039f-924c-4b50-8e0b-513c429c8d81 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:41.376613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 724/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:44.076252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1fb5-6c45-49eb-9145-9165cf67c56b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:44.076824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1fb5-6c45-49eb-9145-9165cf67c56b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:44.076824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f1fb5-6c45-49eb-9145-9165cf67c56b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:44.078261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:44.083681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787b9b-fe53-4d8b-ae8a-727c2abd8978 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:44.084144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787b9b-fe53-4d8b-ae8a-727c2abd8978 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:44.084261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787b9b-fe53-4d8b-ae8a-727c2abd8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:44.101478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8e787b9b-fe53-4d8b-ae8a-727c2abd8978 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:44.102677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8e787b9b-fe53-4d8b-ae8a-727c2abd8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:44.110681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:44.149111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1fb5-6c45-49eb-9145-9165cf67c56b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:44.160006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f1fb5-6c45-49eb-9145-9165cf67c56b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:44.163573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:44.164202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:44.164486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:44.164763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:44.174232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:44.175665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dab7b0-a6f7-4b15-87fa-bab43c44f43e service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:44.185580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 724/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:46.523365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e1bb-7a89-4e97-89ef-39d7a21b0af6 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:46.523904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e1bb-7a89-4e97-89ef-39d7a21b0af6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:46.523904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1e1bb-7a89-4e97-89ef-39d7a21b0af6 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:46.525343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:46.530643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e174-6d1f-43ea-9cd2-c1ccb5b8e880 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:46.531071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e174-6d1f-43ea-9cd2-c1ccb5b8e880 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:46.531203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54e174-6d1f-43ea-9cd2-c1ccb5b8e880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:46.548475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9b54e174-6d1f-43ea-9cd2-c1ccb5b8e880 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:46.549675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9b54e174-6d1f-43ea-9cd2-c1ccb5b8e880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:46.557356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:46.596479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e1bb-7a89-4e97-89ef-39d7a21b0af6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:46.607864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1e1bb-7a89-4e97-89ef-39d7a21b0af6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:46.611457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:46.612090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:46.612378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:46.612655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:46.622782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:46.624355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4fe44-d9d8-44c0-83cc-01991c8005f3 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:46.634416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 727/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:48.986678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44a43-2453-4428-9dd9-36f5fbf38b6b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:48.987204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44a43-2453-4428-9dd9-36f5fbf38b6b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:48.987204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd44a43-2453-4428-9dd9-36f5fbf38b6b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:48.988525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:48.994086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281874-6acd-4cf8-b149-cb012a8fabb2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:48.994504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281874-6acd-4cf8-b149-cb012a8fabb2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:48.994648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc281874-6acd-4cf8-b149-cb012a8fabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:49.012505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-dc281874-6acd-4cf8-b149-cb012a8fabb2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:49.013745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-dc281874-6acd-4cf8-b149-cb012a8fabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:49.021699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:49.059666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44a43-2453-4428-9dd9-36f5fbf38b6b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:49.069975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd44a43-2453-4428-9dd9-36f5fbf38b6b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:49.073459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:49.074129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:49.074409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:49.074684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:49.083156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:49.084578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dabbf6-1e36-4b10-85f7-4cae4671be55 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:49.093909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 727/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:51.369821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e6bf-88a4-4fe2-9459-642e3b14dfbf None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:51.370347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e6bf-88a4-4fe2-9459-642e3b14dfbf None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:51.370454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e6bf-88a4-4fe2-9459-642e3b14dfbf None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:51.371801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:51.377075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b73be-7cd3-4bbf-aa62-ad36261586cf None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:51.377541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b73be-7cd3-4bbf-aa62-ad36261586cf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:51.377732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b73be-7cd3-4bbf-aa62-ad36261586cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:51.395649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b00b73be-7cd3-4bbf-aa62-ad36261586cf None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:51.396842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b00b73be-7cd3-4bbf-aa62-ad36261586cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:51.405364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:51.442463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e6bf-88a4-4fe2-9459-642e3b14dfbf None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:51.453446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e6bf-88a4-4fe2-9459-642e3b14dfbf None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:51.456886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:51.457553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:51.457839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:51.458115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:51.467909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:51.469488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdd5a5-6f42-47cf-ad92-7be5ec619d18 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:51.478698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 730/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:53.855619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee087-fd0b-4cec-8b32-4dcc4aa8cc49 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:53.856189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee087-fd0b-4cec-8b32-4dcc4aa8cc49 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:53.856189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefee087-fd0b-4cec-8b32-4dcc4aa8cc49 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:53.857609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:53.862849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00623-7215-43d8-8fa2-534af84d1976 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:53.863267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00623-7215-43d8-8fa2-534af84d1976 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:53.863408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc00623-7215-43d8-8fa2-534af84d1976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:53.881350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-abc00623-7215-43d8-8fa2-534af84d1976 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:53.882546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-abc00623-7215-43d8-8fa2-534af84d1976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:53.891597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:53.927982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefee087-fd0b-4cec-8b32-4dcc4aa8cc49 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:53.938953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefee087-fd0b-4cec-8b32-4dcc4aa8cc49 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:53.942493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:53.943067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:53.943350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:53.943626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:53.952915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:53.954373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2d12-2420-472f-bcad-35de8199c5ee service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:53.963416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 730/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:56.290236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55c48-7d2e-46c9-94ba-5b381259f274 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:56.290781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55c48-7d2e-46c9-94ba-5b381259f274 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:56.290781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55c48-7d2e-46c9-94ba-5b381259f274 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:56.292186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:56.297613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4041c6-013c-4b0b-979d-5223ba07a194 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:56.298023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4041c6-013c-4b0b-979d-5223ba07a194 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:56.298171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4041c6-013c-4b0b-979d-5223ba07a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:56.315941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2c4041c6-013c-4b0b-979d-5223ba07a194 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:56.317146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2c4041c6-013c-4b0b-979d-5223ba07a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:56.325545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:51:56.361928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55c48-7d2e-46c9-94ba-5b381259f274 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:56.372950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55c48-7d2e-46c9-94ba-5b381259f274 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:56.376420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:56.377066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:56.377428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:56.377701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:56.386280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:56.387702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd73c36-4e26-45bc-8f4d-e1ca41e233aa service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:56.397020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 733/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:51:58.643689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617f36-5c91-44b0-856e-d634b288a5dc None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:58.644296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617f36-5c91-44b0-856e-d634b288a5dc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:58.644296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617f36-5c91-44b0-856e-d634b288a5dc None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:58.645684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:51:58.650897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d44e6-ad53-431c-b37d-b50093014b0b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:58.651332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d44e6-ad53-431c-b37d-b50093014b0b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:58.651514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d44e6-ad53-431c-b37d-b50093014b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:58.670013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c08d44e6-ad53-431c-b37d-b50093014b0b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:51:58.671207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c08d44e6-ad53-431c-b37d-b50093014b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:51:58.678925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:51:58.715883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617f36-5c91-44b0-856e-d634b288a5dc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:51:58.726406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617f36-5c91-44b0-856e-d634b288a5dc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:51:58.730741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:51:58.731534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:51:58.731807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:51:58.732082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:51:58.740904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:51:58.742346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfdf04-e219-4f94-aa26-2c31a7cc4431 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:51:58.752044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 733/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:52:00.977708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309c2d-17e4-46b9-b50b-40ec802b233a None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:00.978235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309c2d-17e4-46b9-b50b-40ec802b233a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:00.978235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309c2d-17e4-46b9-b50b-40ec802b233a None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:00.979558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:00.985464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d6e1-0bdc-424d-ac74-ff0bde0f69d5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:00.985909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d6e1-0bdc-424d-ac74-ff0bde0f69d5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:00.986017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6d6e1-0bdc-424d-ac74-ff0bde0f69d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:01.004057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5dc6d6e1-0bdc-424d-ac74-ff0bde0f69d5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:01.005279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5dc6d6e1-0bdc-424d-ac74-ff0bde0f69d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:01.013003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:01.048758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309c2d-17e4-46b9-b50b-40ec802b233a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:01.059756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309c2d-17e4-46b9-b50b-40ec802b233a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:01.063229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:01.063859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:01.064144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:01.064421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:01.073011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:01.074625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b3b1a-aaf3-473b-9da4-7bf202a55877 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:01.083689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 736/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:52:34.743701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a5ac-30a3-4a17-85bc-7f372b074229 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:34.744931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a5ac-30a3-4a17-85bc-7f372b074229 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:34.744931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a5ac-30a3-4a17-85bc-7f372b074229 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:34.746285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 735/1471] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:34.751455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b96b7-501d-479c-a06f-d93fffe86c7a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:34.751898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b96b7-501d-479c-a06f-d93fffe86c7a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:34.752017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b96b7-501d-479c-a06f-d93fffe86c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:34.769841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7e7b96b7-501d-479c-a06f-d93fffe86c7a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:34.771072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7e7b96b7-501d-479c-a06f-d93fffe86c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:34.779291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 737/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:34.827643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396c61-f3ab-48d6-bd8f-aa9753615b45 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:34.827643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396c61-f3ab-48d6-bd8f-aa9753615b45 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:34.827643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8396c61-f3ab-48d6-bd8f-aa9753615b45 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:34.828276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 736/1473] 10.222.0.49 () {54 vars in 962 bytes} [Wed May 11 12:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:34.832939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4893ea-d5ec-4d04-8770-46246b7bbfb5 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:34.833258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4893ea-d5ec-4d04-8770-46246b7bbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:34.833538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4893ea-d5ec-4d04-8770-46246b7bbfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:34.851423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-da4893ea-d5ec-4d04-8770-46246b7bbfb5 None None] MFA Rules not processed for user `752019a13ba44236ba1c1e13aea6129d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:34.852594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-da4893ea-d5ec-4d04-8770-46246b7bbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:34.859970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 738/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Wed May 11 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:34.867049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396c61-f3ab-48d6-bd8f-aa9753615b45 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:34.878017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8396c61-f3ab-48d6-bd8f-aa9753615b45 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:34.881560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:34.882186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:34.882472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:34.882753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:34.891953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:34.893431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bbeb9-206a-43ce-a48b-7264072fbb43 service glance] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:34.902799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 737/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:52:37.244957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991bbbd-9aa7-4d37-99de-e3dc2a7c340d None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:37.245550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991bbbd-9aa7-4d37-99de-e3dc2a7c340d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:37.245550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991bbbd-9aa7-4d37-99de-e3dc2a7c340d None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:37.246960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 739/1476] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:37.252166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d82c3-741b-4b1d-a34e-4cd1c33b2799 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:37.252587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d82c3-741b-4b1d-a34e-4cd1c33b2799 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:37.252697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d82c3-741b-4b1d-a34e-4cd1c33b2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:37.271950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bf5d82c3-741b-4b1d-a34e-4cd1c33b2799 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:37.273227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bf5d82c3-741b-4b1d-a34e-4cd1c33b2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:37.281246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 738/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:37.304942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991bbbd-9aa7-4d37-99de-e3dc2a7c340d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:37.320671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991bbbd-9aa7-4d37-99de-e3dc2a7c340d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:37.325781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:37.326433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:37.326716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:37.326990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:37.327722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:37.329536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:52:37.329536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:52:37.329536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:52:37.330677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83249-549f-4b70-8b5d-136e7771045a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:37.350017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 740/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 11 12:52:37 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:52:39.610490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b506a-a5d2-485c-9b68-0134f4bece0b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:39.611017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b506a-a5d2-485c-9b68-0134f4bece0b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:39.611017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b506a-a5d2-485c-9b68-0134f4bece0b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:39.612400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 739/1479] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:39.617664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989a7a-7af6-44ca-815e-c50c8ff9da09 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:39.618087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989a7a-7af6-44ca-815e-c50c8ff9da09 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:39.618236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989a7a-7af6-44ca-815e-c50c8ff9da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:39.636920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-76989a7a-7af6-44ca-815e-c50c8ff9da09 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:39.638146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-76989a7a-7af6-44ca-815e-c50c8ff9da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:39.646190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 741/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:39.687842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b506a-a5d2-485c-9b68-0134f4bece0b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:39.702999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b506a-a5d2-485c-9b68-0134f4bece0b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:39.708550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:39.709256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:39.709539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:39.709813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:39.719015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:39.720883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea230bd-b883-4aa4-8822-855aed393dc2 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:39.730548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 740/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:52:42.110640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7014-2b21-4cd7-b13c-0fdbaf1b0b19 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:42.111221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7014-2b21-4cd7-b13c-0fdbaf1b0b19 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:42.111221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7014-2b21-4cd7-b13c-0fdbaf1b0b19 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:42.112571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 742/1482] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:42.117727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8214b-645e-4c18-a945-dd753ef5ceed None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:42.118178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8214b-645e-4c18-a945-dd753ef5ceed None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:42.118899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8214b-645e-4c18-a945-dd753ef5ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:42.136347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-80d8214b-645e-4c18-a945-dd753ef5ceed None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:42.137846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-80d8214b-645e-4c18-a945-dd753ef5ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:42.145832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 741/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:42.181975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7014-2b21-4cd7-b13c-0fdbaf1b0b19 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:42.192514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7014-2b21-4cd7-b13c-0fdbaf1b0b19 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:42.196089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:42.196840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:42.197161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:42.197441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:42.206156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:42.210352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da537a9a-043c-4232-96a0-e694f60afb6f service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:42.216920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 743/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:52:44.484771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f04f-9614-41d4-a5d2-eb1024747b2b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:44.485379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f04f-9614-41d4-a5d2-eb1024747b2b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:44.485379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741f04f-9614-41d4-a5d2-eb1024747b2b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:44.486724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 742/1485] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:44.491845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f37b50-f68d-4374-8cb6-6ee1863cedb9 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:44.492267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f37b50-f68d-4374-8cb6-6ee1863cedb9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:44.492401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f37b50-f68d-4374-8cb6-6ee1863cedb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:44.512334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b0f37b50-f68d-4374-8cb6-6ee1863cedb9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:44.513557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b0f37b50-f68d-4374-8cb6-6ee1863cedb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:44.521578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 744/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:44.558819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741f04f-9614-41d4-a5d2-eb1024747b2b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:44.569207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741f04f-9614-41d4-a5d2-eb1024747b2b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:44.573208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:44.573833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:44.574114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:44.574389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:44.582888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:44.584304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d3b40-589a-45ce-b313-53057df69a42 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:44.594234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 743/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:52:46.994028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0399-0d3a-4b27-b338-1dd762fc2e5d None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:46.994741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0399-0d3a-4b27-b338-1dd762fc2e5d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:46.994741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda0399-0d3a-4b27-b338-1dd762fc2e5d None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:46.996107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 745/1488] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:47.001541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1294-2d33-4f0c-bb89-96218d5670b7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:47.001995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1294-2d33-4f0c-bb89-96218d5670b7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:47.002316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e1294-2d33-4f0c-bb89-96218d5670b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:47.021418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4c3e1294-2d33-4f0c-bb89-96218d5670b7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:47.022790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4c3e1294-2d33-4f0c-bb89-96218d5670b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:47.033247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 744/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:47.073495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda0399-0d3a-4b27-b338-1dd762fc2e5d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:47.083871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda0399-0d3a-4b27-b338-1dd762fc2e5d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:47.087450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:47.088076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:47.088357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:47.088633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:47.097242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:47.098668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eda1ee-22f2-4c9f-9e2a-87ff37350ffc service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:47.107785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 746/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:52:49.715241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401a12-67e0-43c4-a563-4391ed4681bd None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:49.715787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401a12-67e0-43c4-a563-4391ed4681bd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:49.715787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e401a12-67e0-43c4-a563-4391ed4681bd None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:49.717196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 745/1491] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 11 12:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:52:49.722486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad89dc-a819-474b-9d2f-2b97f380df40 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:49.722913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad89dc-a819-474b-9d2f-2b97f380df40 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:49.723067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad89dc-a819-474b-9d2f-2b97f380df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:49.745692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-55ad89dc-a819-474b-9d2f-2b97f380df40 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:52:49.746887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-55ad89dc-a819-474b-9d2f-2b97f380df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:52:49.755843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 747/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 11 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:52:49.794911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e401a12-67e0-43c4-a563-4391ed4681bd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:52:49.805435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e401a12-67e0-43c4-a563-4391ed4681bd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:52:49.809450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:52:49.810083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:52:49.810363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:52:49.810635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:52:49.819169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:52:49.820593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a782-6948-4973-96c1-879a720fe696 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:52:49.829654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 746/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:54:26.475654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.476252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.476252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.494520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:54:26.495697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:26.503673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 748/1494] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:54:26.513350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.514092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.514191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.531564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:54:26.532781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:26.540601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 747/1495] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:54:26.544905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:26.555011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f928-13af-4329-84e3-6d76c0675db4 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:26.559430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:26.560073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.560355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.560630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.561382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:54:26.561684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:26.562683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:26.562683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:54:26.562683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:54:26.563571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:26.575576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 749/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:54:26.584120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:26.593065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba45164-8f63-4728-9ae9-1302aa3ac8bd None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:26.597661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:26.598307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.598591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.599436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.600113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:26.601907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:26.601907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:54:26.601907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:54:26.603100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:26.742242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 748/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:54:26 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:54:26.746510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:26.757293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19c62b-f13c-4cfe-96ab-7fae784ff26d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:26.810071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:26.810726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.811010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.811568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.812256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:26.813290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:26.813290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:54:26.813290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:54:26.814472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:26.934313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 750/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:54:26 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:54:26.938575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:26.949353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02726cba-6485-40d1-823e-6bb2b20a6c28 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:26.953887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:26.954540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.954822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.955146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.955802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:26.956808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:26.956808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:54:26.956808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:54:26.957724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:26.970714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 749/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:54:26.974876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:26.984536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a64d4a-ac4a-4f60-94c0-9e38ccf682aa admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:26.988944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:26.989639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:26.989919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:26.990197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:26.990919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:26.991920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:26.991920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:54:26.991920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:54:26.992856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fba594-5af0-4baa-924e-c84892dc0340 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:27.006200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 751/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:54:27.010282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:27.020123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413a89-e256-41fa-a46f-6135e5eab882 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:27.025722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:27.026590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.026870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.027143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] PATH_INFO: `/v3/projects/f7ecbf96cab54b42a53d73af050a9439/users/520e3bd53c794bc0994f6206873349ee/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.041465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ecbf96cab54b42a53d73af050a9439, user_id=520e3bd53c794bc0994f6206873349ee, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:27.042490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:27.042490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:54:27.042490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:54:27.044395 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667da36-27b9-431b-adbc-809712629079 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:27.105719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 750/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:54:27 2022] PUT /identity/v3/projects/f7ecbf96cab54b42a53d73af050a9439/users/520e3bd53c794bc0994f6206873349ee/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:54:27.117397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6581-0b69-402f-8a89-cdb773bd2831 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.117684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6581-0b69-402f-8a89-cdb773bd2831 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.117961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6581-0b69-402f-8a89-cdb773bd2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.144769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e35e6581-0b69-402f-8a89-cdb773bd2831 None None] MFA Rules not processed for user `520e3bd53c794bc0994f6206873349ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:54:27.146032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e35e6581-0b69-402f-8a89-cdb773bd2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:27.206444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 752/1502] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:54:27.219442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85659-e7bd-4cd4-807b-009c7640fc8d None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.219739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85659-e7bd-4cd4-807b-009c7640fc8d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.220019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad85659-e7bd-4cd4-807b-009c7640fc8d None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.221435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 751/1503] 10.222.0.49 () {54 vars in 963 bytes} [Wed May 11 12:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:54:27.226996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff864-0655-4e43-9959-2c2256481a84 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.227285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff864-0655-4e43-9959-2c2256481a84 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.227563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ff864-0655-4e43-9959-2c2256481a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.245265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a24ff864-0655-4e43-9959-2c2256481a84 None None] MFA Rules not processed for user `eee618b771c149d98b108e389c511acf`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:54:27.246361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a24ff864-0655-4e43-9959-2c2256481a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:27.294322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 753/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Wed May 11 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:54:27.301692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85659-e7bd-4cd4-807b-009c7640fc8d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:27.312673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad85659-e7bd-4cd4-807b-009c7640fc8d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:27.316145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:27.316773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.317079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.317369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.327920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:27.329379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:27.338091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 752/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:54:27.379608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-44ef-4091-9d7b-b870b658ea40 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.379905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-44ef-4091-9d7b-b870b658ea40 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.380893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef1b9-44ef-4091-9d7b-b870b658ea40 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.382437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 754/1506] 10.222.0.49 () {52 vars in 829 bytes} [Wed May 11 12:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:54:27.385925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:27.451131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52e6a-f427-44e1-b205-936964c7d4b2 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:27.456498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:27.457410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.457695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.457974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] PATH_INFO: `/v3/users/520e3bd53c794bc0994f6206873349ee` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.459277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520e3bd53c794bc0994f6206873349ee)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:27.460285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:27.460285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:54:27.460285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:54:27.461525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:27.688279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520e3bd53c794bc0994f6206873349ee'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:27.700975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520e3bd53c794bc0994f6206873349ee'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:27.701800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520e3bd53c794bc0994f6206873349ee'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:27.752407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520e3bd53c794bc0994f6206873349ee'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:27.753169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520e3bd53c794bc0994f6206873349ee'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:27.777684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 753/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:54:27 2022] DELETE /identity/v3/users/520e3bd53c794bc0994f6206873349ee => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:54:27.782149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.782613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.782720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.800967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:54:27.803262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:27.860006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 755/1508] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:54:27.870645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:27.872056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:27.929806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64658607-3070-43e4-8091-8914d623b3c3 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:27.933528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:27.934178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:27.934463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:27.934744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:27.943915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:27.945330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbef68-e0b3-47ab-8a48-d76da5abc2db service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:27.954568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 754/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:54:28.405469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:54:28.407023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:54:28.419717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcc790-8276-4dff-bd80-fcd6888546b8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:54:28.424319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:54:28.425292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:54:28.425560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:54:28.425898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] PATH_INFO: `/v3/projects/f7ecbf96cab54b42a53d73af050a9439` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:54:28.428181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ecbf96cab54b42a53d73af050a9439)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:54:28.428775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:54:28.428775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:54:28.428775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:54:28.430749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:54:28.539724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ecbf96cab54b42a53d73af050a9439', 'request_id': 'req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:28.545636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ecbf96cab54b42a53d73af050a9439', 'request_id': 'req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:28.647670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ecbf96cab54b42a53d73af050a9439', 'request_id': 'req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:28.667230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] The token cache is being invalidate because project f7ecbf96cab54b42a53d73af050a9439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:54:28.667519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:28.668254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-503f90e7-d9b5-45c4-98a3-a3e4c2d54fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:54:28.669823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 756/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:54:28 2022] DELETE /identity/v3/projects/f7ecbf96cab54b42a53d73af050a9439 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:56:11.004346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:11.004942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:11.004942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:11.006243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:11.011128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4a48-6b6e-4b8c-b1d4-e508dbb2aec6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:11.011555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4a48-6b6e-4b8c-b1d4-e508dbb2aec6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:11.011665 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4a48-6b6e-4b8c-b1d4-e508dbb2aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:11.030111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-307f4a48-6b6e-4b8c-b1d4-e508dbb2aec6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:11.031370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-307f4a48-6b6e-4b8c-b1d4-e508dbb2aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:11.086728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:11.269526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:11.271139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:11.343129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb066b-eb5b-4ccb-afa7-806f8c3e4d84 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:11.348645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:11.349314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:11.349603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:11.349880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:11.357902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:11.360035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86c0af-a4a1-4656-9fe1-1f32a3df1bb0 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:11.369666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 756/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:12.000648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067911d-42a5-4d59-91db-115df9f9f93c None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:12.000879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067911d-42a5-4d59-91db-115df9f9f93c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:12.001145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067911d-42a5-4d59-91db-115df9f9f93c None None] PATH_INFO: `/v3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:12.002487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 758/1514] 10.222.0.24 () {54 vars in 925 bytes} [Wed May 11 12:56:11 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:56:12.008850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e2b7-7e7f-404e-a083-fa5b8e1fd1f2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:12.009371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e2b7-7e7f-404e-a083-fa5b8e1fd1f2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:12.009467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6e2b7-7e7f-404e-a083-fa5b8e1fd1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:12.028123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-47e6e2b7-7e7f-404e-a083-fa5b8e1fd1f2 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:12.029342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-47e6e2b7-7e7f-404e-a083-fa5b8e1fd1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:12.089393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 757/1515] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:12.274657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584589c-7e54-40a8-8ea2-bd6c19c8453e None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:12.275204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584589c-7e54-40a8-8ea2-bd6c19c8453e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:12.275204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584589c-7e54-40a8-8ea2-bd6c19c8453e None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:12.276502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:12.281938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8093d4-4afc-488e-9041-c73cec777082 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:12.282659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8093d4-4afc-488e-9041-c73cec777082 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:12.282939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8093d4-4afc-488e-9041-c73cec777082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:12.300882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cb8093d4-4afc-488e-9041-c73cec777082 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:12.302084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cb8093d4-4afc-488e-9041-c73cec777082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:12.309708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:12.460123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584589c-7e54-40a8-8ea2-bd6c19c8453e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:12.474581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584589c-7e54-40a8-8ea2-bd6c19c8453e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:12.479804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:12.480429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:12.480711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:12.480982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:12.489071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:12.490667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1ab82-0940-498f-a29f-13289e538ae1 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:12.499699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 760/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:21.282737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20b4-a4e2-4ec9-8991-c3fb5792bd7f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:21.283274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20b4-a4e2-4ec9-8991-c3fb5792bd7f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:21.283274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b20b4-a4e2-4ec9-8991-c3fb5792bd7f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:21.284650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 759/1519] 10.222.0.49 () {54 vars in 960 bytes} [Wed May 11 12:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:21.289725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07733-bfa5-4616-8c4e-1d55915bc0d0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:21.290149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07733-bfa5-4616-8c4e-1d55915bc0d0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:21.290282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd07733-bfa5-4616-8c4e-1d55915bc0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:21.308172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1fd07733-bfa5-4616-8c4e-1d55915bc0d0 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:21.309425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1fd07733-bfa5-4616-8c4e-1d55915bc0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:21.317989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 761/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Wed May 11 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:21.326669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b20b4-a4e2-4ec9-8991-c3fb5792bd7f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:21.340361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b20b4-a4e2-4ec9-8991-c3fb5792bd7f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:21.345955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:21.346644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:21.346933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:21.347213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:21.355429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:21.357010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3dd721-085f-45b2-9506-6896c032ae81 service placement] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:21.366560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 760/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:23.831195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a024b-9ac5-4709-b6ba-1cabf25f64f7 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:23.831743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a024b-9ac5-4709-b6ba-1cabf25f64f7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:23.831743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a024b-9ac5-4709-b6ba-1cabf25f64f7 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:23.833233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:23.837968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503a7c-16bc-4bd3-bbc8-e166ac31cd63 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:23.838369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503a7c-16bc-4bd3-bbc8-e166ac31cd63 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:23.838533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11503a7c-16bc-4bd3-bbc8-e166ac31cd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:23.856545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-11503a7c-16bc-4bd3-bbc8-e166ac31cd63 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:23.857777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-11503a7c-16bc-4bd3-bbc8-e166ac31cd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:23.866349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:24.025323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a024b-9ac5-4709-b6ba-1cabf25f64f7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:24.039999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a024b-9ac5-4709-b6ba-1cabf25f64f7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:24.045382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:24.046015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:24.046848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:24.047189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:24.055041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:24.056617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e4950-8172-420d-b83f-f8fe018dfe51 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:24.066143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 763/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:24.947697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5bb7-8cc9-4a2d-99b8-28840d597b88 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:24.948212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5bb7-8cc9-4a2d-99b8-28840d597b88 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:24.948212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5bb7-8cc9-4a2d-99b8-28840d597b88 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:24.949621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 12:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:24.954962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8874-a03f-4c7b-ac16-9933c887ad99 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:24.955410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8874-a03f-4c7b-ac16-9933c887ad99 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:24.955546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb8874-a03f-4c7b-ac16-9933c887ad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:24.973566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-64bb8874-a03f-4c7b-ac16-9933c887ad99 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:24.974748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-64bb8874-a03f-4c7b-ac16-9933c887ad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:24.982602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:25.135924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5bb7-8cc9-4a2d-99b8-28840d597b88 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:25.151429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5bb7-8cc9-4a2d-99b8-28840d597b88 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:25.157474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:25.158108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:25.158389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:25.158659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:25.166766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:25.168374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c3f01-1ca1-4181-806a-fcc7ea456c6d service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:25.177694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 763/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:29.683575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:29.684173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:29.684173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:29.685539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:29.691443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bceb4e-bc37-4d79-8891-c2fe6430a4f1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:29.691928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bceb4e-bc37-4d79-8891-c2fe6430a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:29.692036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bceb4e-bc37-4d79-8891-c2fe6430a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:29.710484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-06bceb4e-bc37-4d79-8891-c2fe6430a4f1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:29.711682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-06bceb4e-bc37-4d79-8891-c2fe6430a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:29.719811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:29.756545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:29.758295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:29.815549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9a023-42c1-4cc9-91e5-e4ac244a0f99 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:29.819186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:29.819863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:29.820177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:29.820457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:29.830118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:29.831579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437de5f-d0ec-4b62-bc17-d9386513bf58 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:29.840750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 766/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:32.051852 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cf6d-9103-49ad-81d1-fc6d6006561b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:32.052418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cf6d-9103-49ad-81d1-fc6d6006561b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:32.052418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041cf6d-9103-49ad-81d1-fc6d6006561b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:32.053831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:32.059135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0cce-0dbf-40a8-a930-a77c24f4cd7b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:32.059528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0cce-0dbf-40a8-a930-a77c24f4cd7b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:32.059694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a0cce-0dbf-40a8-a930-a77c24f4cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:32.078374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7d8a0cce-0dbf-40a8-a930-a77c24f4cd7b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:32.079577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7d8a0cce-0dbf-40a8-a930-a77c24f4cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:32.087246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:32.122227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041cf6d-9103-49ad-81d1-fc6d6006561b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:32.133258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041cf6d-9103-49ad-81d1-fc6d6006561b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:32.136794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:32.137752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:32.146253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:32.146253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:32.148353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:32.149825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc7cde-16af-4d8d-a9e3-3f9e4c091306 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:32.159317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 766/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:35.793148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:35.793667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:35.793667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:35.795059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:35.800407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796d90d-6923-43e7-8ddf-a4dd289b02b2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:35.800838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796d90d-6923-43e7-8ddf-a4dd289b02b2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:35.800944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796d90d-6923-43e7-8ddf-a4dd289b02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:35.819080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3796d90d-6923-43e7-8ddf-a4dd289b02b2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:35.820257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3796d90d-6923-43e7-8ddf-a4dd289b02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:35.828759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:56:36.098455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:36.100103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:36.155841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e630ac-270f-45ab-a5f2-aeb717085142 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:36.159512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:36.160153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:36.160437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:36.160711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:36.169500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:36.170930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cbda3-6c3f-4f64-a087-c6e5a7f89154 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:36.180708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 769/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:56:38.439934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:38.440522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:38.440522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:38.441906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 12:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:56:38.447079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69ec4-8b95-460e-856f-1a62b38a95e1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:38.447502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69ec4-8b95-460e-856f-1a62b38a95e1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:38.447652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69ec4-8b95-460e-856f-1a62b38a95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:38.466245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-45e69ec4-8b95-460e-856f-1a62b38a95e1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:56:38.467482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-45e69ec4-8b95-460e-856f-1a62b38a95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:38.475826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 12:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:56:38.753230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:56:38.754998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:56:38.768561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d594b0-e9ab-4a51-a2d9-5831bd933615 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:56:38.772081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:56:38.772714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:56:38.772998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:56:38.773307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:56:38.781964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:56:38.783381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482962f-6bce-4c9c-a65f-dbe647a28769 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:56:38.792873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 769/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:11.335639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.336697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.337263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.368253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.374272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.388712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 771/1540] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:11.399562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.400627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.401259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.430094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.431756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.440673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.446063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:11.457834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9942da0-9dd6-4db2-a199-44c3c2d9d1a3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:11.465714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:11.466394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.466679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.466958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.467862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:11.468177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:11.469834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf1d98-66d2-492c-b9fd-82f53b01a2e2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:11.487961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 772/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:11.496876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:11.510769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67f6ef-b7f3-437c-a1ae-f83ecb1e3584 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:11.520304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:11.520986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.521310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.521584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.522295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:11.524222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e459-65e8-4935-8b58-2e6f87ac8158 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:11.577056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b822-1153-43d2-ba75-e99f0a04ecaf None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.577450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b822-1153-43d2-ba75-e99f0a04ecaf None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.577639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611b822-1153-43d2-ba75-e99f0a04ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.606658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2611b822-1153-43d2-ba75-e99f0a04ecaf None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.607829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2611b822-1153-43d2-ba75-e99f0a04ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.622768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 773/1543] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 11 12:58:11.623597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96285e-6e74-4fa9-aa58-d55af77fe5c3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.623896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96285e-6e74-4fa9-aa58-d55af77fe5c3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.624182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96285e-6e74-4fa9-aa58-d55af77fe5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.652971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ea96285e-6e74-4fa9-aa58-d55af77fe5c3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.654522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ea96285e-6e74-4fa9-aa58-d55af77fe5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.666095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 771/1544] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:11.669085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 774/1545] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.670279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f8f-7439-44a3-982d-c0c492d6d1ba None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.670580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f8f-7439-44a3-982d-c0c492d6d1ba None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.670854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f8f-7439-44a3-982d-c0c492d6d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.672894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.673215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.673575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.704398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0a050f8f-7439-44a3-982d-c0c492d6d1ba None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.705671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0a050f8f-7439-44a3-982d-c0c492d6d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.720098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.721342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.821301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 775/1546] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.822960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ba58-f187-46b4-b50b-6b60eb719e69 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.823261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ba58-f187-46b4-b50b-6b60eb719e69 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.823545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953ba58-f187-46b4-b50b-6b60eb719e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.830303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 772/1547] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.831260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:11.840384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46fc9d-7fe0-4fce-b32a-5d776a7d0169 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:11.842117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d953ba58-f187-46b4-b50b-6b60eb719e69 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.843436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d953ba58-f187-46b4-b50b-6b60eb719e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.844861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:11.845541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.845825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.846099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.846772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:11.847792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:11.847792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:58:11.847792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:58:11.848994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19fab3-6c70-4358-ba44-cf3fd7e97a74 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:11.856559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 776/1548] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.856559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb16f9-5975-4d19-8685-be0f4273ad5e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.856559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb16f9-5975-4d19-8685-be0f4273ad5e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.856559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb16f9-5975-4d19-8685-be0f4273ad5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.875415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-95cb16f9-5975-4d19-8685-be0f4273ad5e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.876517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-95cb16f9-5975-4d19-8685-be0f4273ad5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.884278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 777/1549] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.885636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825716f3-b273-409f-a393-c35978275724 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.885920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825716f3-b273-409f-a393-c35978275724 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.886197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825716f3-b273-409f-a393-c35978275724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.904091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-825716f3-b273-409f-a393-c35978275724 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.905274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-825716f3-b273-409f-a393-c35978275724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.912774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 778/1550] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.914157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e8d8-49c4-4611-88c1-05b9d6ba58e5 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.914440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e8d8-49c4-4611-88c1-05b9d6ba58e5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.914711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206e8d8-49c4-4611-88c1-05b9d6ba58e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.931663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-6206e8d8-49c4-4611-88c1-05b9d6ba58e5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.932820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6206e8d8-49c4-4611-88c1-05b9d6ba58e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.941034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 779/1551] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.942291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.942581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.942858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.958265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 773/1552] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:11.959808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c9ee-b2a9-493a-8045-d102996d8643 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.960101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c9ee-b2a9-493a-8045-d102996d8643 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.960380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c9ee-b2a9-493a-8045-d102996d8643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.960956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.962306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.971430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 780/1553] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:11.972270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:11.982324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4bca-f40f-4b01-b800-69dd091ad510 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:11.985114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4187c9ee-b2a9-493a-8045-d102996d8643 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:11.986418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4187c9ee-b2a9-493a-8045-d102996d8643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:11.989058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:11.989370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:11.989658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:11.989939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:11.990753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:11.993750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:11.993750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:11.998906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 774/1554] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:12.000398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f4ed-b2fe-4f56-b484-0fc0e1315800 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.000823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f4ed-b2fe-4f56-b484-0fc0e1315800 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.001310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f4ed-b2fe-4f56-b484-0fc0e1315800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.014338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 781/1555] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.014338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.017674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08349ec8-89fa-40d3-bae2-f99b88a64301 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.021244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9ad8f4ed-b2fe-4f56-b484-0fc0e1315800 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:12.022217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.022432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9ad8f4ed-b2fe-4f56-b484-0fc0e1315800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:12.022860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.023145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.023425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.024139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.024668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.026297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea2598-d027-4655-8e92-85226b4cebec admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.030705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 775/1556] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:12.031925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.032207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.032479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.044161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 782/1557] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.044161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67931-0287-4f32-bb70-c27f5ec1ca9d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.044161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67931-0287-4f32-bb70-c27f5ec1ca9d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.044161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a67931-0287-4f32-bb70-c27f5ec1ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.050874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:12.052048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:12.060847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 776/1558] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:12.061468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a4a67931-0287-4f32-bb70-c27f5ec1ca9d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:12.061672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.062836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a4a67931-0287-4f32-bb70-c27f5ec1ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:12.070759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 783/1559] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:12.070906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea92fec-b925-40ba-83e6-f3edb6e92ec9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.071963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.072242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.072577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.076000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.076651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.076931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.077235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.077956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.079540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.089487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 777/1560] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:12.090397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.090698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:12.092040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:12.099735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e16bf-8d52-4aea-a423-03a4d8695d29 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.100040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 784/1561] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:12.100783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.108417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.109068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.109365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.109643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.110352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.110655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.110838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69673d-86ef-44cc-b764-78306f564236 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.111656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:12.111656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:58:12.111656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:58:12.112526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.115186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.115818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.116102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.116379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.117085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.118233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:12.118233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:58:12.118233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:58:12.119403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.125135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 778/1562] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.125966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.135194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe4d6-64d2-4a15-b611-73865be8cba9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.140523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.141190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.141471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.141747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.142500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.142804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.144363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.155927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 779/1563] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.156666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.165882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888aee74-6f11-4ea6-ad6f-548d13069388 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.171110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.181737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.181737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.181737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.181737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.181737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.208704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 785/1564] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.209565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.266188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 780/1565] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.267002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.271876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcac62-a11e-47bb-a271-5074117f1307 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.327111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.327780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.328070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.328257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667432be-fcd2-4bfa-9e2c-45f30c5da7d2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.328377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.329090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.329410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.331012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.335185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.335185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.335185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.335185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.335575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.335840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.337461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.343031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 786/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.343980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.359143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 781/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.359143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.359477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e2389-ef34-4447-a185-96a74bf07ad4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.359477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.360151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.360446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.360797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.361569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.365189 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bfe5-8a4a-4c77-96c0-463a86186877 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.365462 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.367570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.368223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.368514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.368946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.369705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:12.370022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.372196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.375039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 787/1568] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:12.375828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.385500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 782/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:12.385742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733266f-925b-4969-83b4-b529db539f53 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.386264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.391670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.392326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.393964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.393964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.393964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.395795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.397162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf21e-24f2-4c3a-8a4b-15a6e0b86084 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.401958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.402599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.402971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.403304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.404025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.406445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.471280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 788/1570] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.472164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.491251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 783/1571] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.491942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.535850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7af5a-4def-4dbc-a956-1c0ba41ddb65 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.552524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143e64c-58e9-4ce0-ba41-7d0e40067215 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.557113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.557785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.558075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.558356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.559566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.561741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.589817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.590534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.590818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.591083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.591805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.593955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.678712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 784/1572] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.679193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 789/1573] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.679607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.680113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.690386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35e7d2-ff26-4f01-999b-49f5853c92ee admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.690694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce40e78-9615-4564-b498-978bbbaad86b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.695279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.695448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.696057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.696156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.696344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.696510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.696621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.696721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.697418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.697534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.699360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.699486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.795296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 785/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.797087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.818447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 790/1575] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.818447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.862050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b05d0a-dc0d-47f9-82d5-dfff6908dfa8 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.877116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48941242-2f72-4fe6-8ab9-052f4b981b5b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:12.881769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.882424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.882711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.882997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.883687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:12.885632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:12.916604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:12.917521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:12.917794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:12.918062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] PATH_INFO: `/v3/projects/c9b8255d3f93411b94ed87118f74d7eb/users/f77d9e1f887e4b55ae8e982c00a735e0/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:12.964408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 791/1576] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:12.965292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:12.997488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b8255d3f93411b94ed87118f74d7eb, user_id=f77d9e1f887e4b55ae8e982c00a735e0, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.000448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.025967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070266-cade-4522-9a9f-4d4afead1dee admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.030813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.031478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.031761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.032034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.032709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.034650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.089270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 786/1577] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:12 2022] PUT /identity/v3/projects/c9b8255d3f93411b94ed87118f74d7eb/users/f77d9e1f887e4b55ae8e982c00a735e0/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:13.090921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.146605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 792/1578] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:12 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:13.147394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.154795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb9e3-f367-43e2-9ffc-5ca6c0830b8c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.157003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7447d-5520-4fde-9318-979881cf55ac admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.159456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.160256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.160552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.160829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.161560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.161698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.162348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.162684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.162963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.163673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.163783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.165331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.175971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 793/1579] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.176765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.186878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db3de-e0dd-481e-8ce0-036d2a2b4960 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.191502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.192140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.192428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.192707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.193451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.195030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.206096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 794/1580] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.206844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.218439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531d37-ff79-4735-a4cb-d55774c49444 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.220488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.221126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.221413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.221687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.222348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.224187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.245076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 787/1581] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:13.245076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.254419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8ef6b-3f9a-4627-b2bb-0ba1043bc782 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.259152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.259794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.260075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.260347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.261017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.264208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942d49-6670-49a3-bfd4-45f7456410c5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.317982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 795/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:13.318939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.329241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287f2cc-faea-4937-8090-df08a794ba98 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.333848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.334481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.334762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.335036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.335702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.337653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.346289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 788/1583] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:13.347655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.348013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.348353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.366222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:13.367409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:13.375883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 789/1584] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:13.376637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.385974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79305a3a-bd15-4d73-bf56-dafda7a47bc7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.391521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.392169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.392453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.392758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.393523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.395124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.404990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 790/1585] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.412329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.414711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec92bd-2106-49ad-b674-9b2090c848e1 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.419301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.419912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.420192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.420466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.421190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.422722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.432140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 791/1586] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.433206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.441438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 796/1587] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:13.441438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.443956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9819ba-2667-44b7-b161-20edacad162c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.448469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.449142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.449428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.450286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.451124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.451261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f51a-927c-49ca-8a2e-13337158d7cf admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.452700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.456362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.457100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.457397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.457678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.458411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.460001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.462911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 792/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.465763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.473862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b9cc-3288-4f21-8cbf-1e79d365e9fc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.474037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 797/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.478258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.478443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.479110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.479404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.479678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.480398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.482596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.489776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7703-2929-4568-8b4b-7938930e1eb9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.498061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 793/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.498061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.498997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.499663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.499948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.500369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.501211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.502857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.513520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 798/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.517193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.526827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43971-4ab3-4752-a2a7-7b855b8f8cd4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.533221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.533909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.534296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.534688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.535521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.537310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.548394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 799/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.549309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.552750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77114d9-53d0-400e-bab1-8e2602ae125e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.556462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.557138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.557423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.557698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.558630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf5ec6-7108-48c4-ab65-e0d826a7a4c3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.563295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.564156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.564438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.564715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] PATH_INFO: `/v3/projects/3aa75ac80d014d22b5ee5eac0eff01f1/users/69d10c8e25734bc68c43a25c2de9510e/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.567192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.568625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.580063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa75ac80d014d22b5ee5eac0eff01f1, user_id=69d10c8e25734bc68c43a25c2de9510e, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.581138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:13.581138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:58:13.581138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:58:13.581542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 794/1593] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:13.582892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.583078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.594148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90173921-cff3-40b8-acbd-5ebfd7d794b6 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.598766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.599421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.599706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.599980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.600750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.602393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.613084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 795/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.614199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.625207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df037b4-f11f-458a-9674-f43673079fe2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.629954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.630829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.631112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.631388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] PATH_INFO: `/v3/projects/71bc6040267d48ae87a84efad9be6fe4/users/e2074c33e19940eba5fc2ac957f5636a/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.646279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bc6040267d48ae87a84efad9be6fe4, user_id=e2074c33e19940eba5fc2ac957f5636a, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.648983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.673144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 800/1595] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:13 2022] PUT /identity/v3/projects/3aa75ac80d014d22b5ee5eac0eff01f1/users/69d10c8e25734bc68c43a25c2de9510e/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:13.674170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.747785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 796/1596] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:13 2022] PUT /identity/v3/projects/71bc6040267d48ae87a84efad9be6fe4/users/e2074c33e19940eba5fc2ac957f5636a/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:13.748355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.751667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a31ae-097d-4641-b5c8-2680a347eb90 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.807466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.808143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.808433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.808711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.809669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.811440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.815502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1839f9-ee6f-4daf-9119-fe319354778e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.820644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.826877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.827003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 801/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.827113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.827113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.827291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.827389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.827389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.832179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cdf5-d00d-43ff-bb45-6835659babda admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.836467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 797/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.837165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.837343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.837822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.838107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.838425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.839302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.841662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.848016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad44ea-ea5d-4058-8c1d-0daf99d4bebb admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.853287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.853508 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 802/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.861809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.861949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:13.862046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.862046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] PATH_INFO: `/v3/projects/4075bd7b7de04b7b89f2d5e9230faddd/users/be0acb3806f647dba73cf6bb9bf55267/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.867123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f292-4979-4768-8d5d-6a0862219629 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:13.871200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4075bd7b7de04b7b89f2d5e9230faddd, user_id=be0acb3806f647dba73cf6bb9bf55267, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.873538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:13.874290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.874771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.874884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a650ecda-611d-4666-8219-7fa1cd3238da admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.874976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.875722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:13.877445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ded3d7-a58f-473d-b0f3-f2edb4f977f5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:13.889464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 803/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:13.895951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.895951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.895951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.930260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] MFA Rules not processed for user `69d10c8e25734bc68c43a25c2de9510e`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:13.930260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:13.956106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 798/1601] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:13 2022] PUT /identity/v3/projects/4075bd7b7de04b7b89f2d5e9230faddd/users/be0acb3806f647dba73cf6bb9bf55267/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:13.957577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:13.966274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:13.966274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:13.979547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:13.980968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:13.999215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 804/1602] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.000612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.016184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee31a4e-e5a6-400c-8512-32b366de8406 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.042093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 799/1603] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.042922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.053439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001227-c764-4d68-a637-39dcc057ce8e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.058307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.059390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.059682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.059978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] PATH_INFO: `/v3/projects/4e3208970f45410aa44db86da14ae159/users/da86fdd1a57d4a319f1158e76079ea6b/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.076791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3208970f45410aa44db86da14ae159, user_id=da86fdd1a57d4a319f1158e76079ea6b, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.078064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.079002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.079286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.079569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] PATH_INFO: `/v3/projects/7f9f428da01b4b9eb0ca5a5fce438b6b/users/a1f0b90b689143e79e005550c41d6484/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.080120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.095123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f428da01b4b9eb0ca5a5fce438b6b, user_id=a1f0b90b689143e79e005550c41d6484, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.098535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.156349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 800/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:14 2022] PUT /identity/v3/projects/4e3208970f45410aa44db86da14ae159/users/da86fdd1a57d4a319f1158e76079ea6b/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:14.160428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.211576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 805/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:13 2022] PUT /identity/v3/projects/7f9f428da01b4b9eb0ca5a5fce438b6b/users/a1f0b90b689143e79e005550c41d6484/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:14.212461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.223707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096566b-b06e-45d9-9a70-9c00f58a8f2e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.275188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f113-0f35-4595-96b4-0046ffbaac4f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.280193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.282703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.282703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.282703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] PATH_INFO: `/v3/projects/dd992f281b774ce88c3dfd119e87f968/users/eda7f9be6e924c6cba0a67cbb3c01052/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.282986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.282986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.282986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.283263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] PATH_INFO: `/v3/projects/e1675a05d38a49b08e9b59a89af3e859/users/8cb596917a57452f9e06d51f2bcecd25/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.296383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd992f281b774ce88c3dfd119e87f968, user_id=eda7f9be6e924c6cba0a67cbb3c01052, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.297951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1675a05d38a49b08e9b59a89af3e859, user_id=8cb596917a57452f9e06d51f2bcecd25, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.299076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf1115-f2ed-4ade-9b55-fc19c25b12d9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.301671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.380659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 806/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:14 2022] PUT /identity/v3/projects/dd992f281b774ce88c3dfd119e87f968/users/eda7f9be6e924c6cba0a67cbb3c01052/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:14.382064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.382312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.382561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.414469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 801/1607] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:14 2022] PUT /identity/v3/projects/e1675a05d38a49b08e9b59a89af3e859/users/8cb596917a57452f9e06d51f2bcecd25/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:14.414469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.421945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] MFA Rules not processed for user `be0acb3806f647dba73cf6bb9bf55267`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:14.422680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.475268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8cd2d-4fa6-447d-9e55-15989a2dfc0f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.479326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.479887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.480266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.480621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.487665 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 807/1608] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.491882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.541849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.543226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a302c-bdbb-455a-8a10-2002f78ec534 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.547491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3eb11-a251-4508-a5c2-57f52e931912 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.551204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.551855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.552156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.552435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.552655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 802/1609] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:14.553985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756572-a522-43ee-9436-a2bf6cecc232 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.554233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756572-a522-43ee-9436-a2bf6cecc232 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.554510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98756572-a522-43ee-9436-a2bf6cecc232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.574499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-98756572-a522-43ee-9436-a2bf6cecc232 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:14.576289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-98756572-a522-43ee-9436-a2bf6cecc232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.626586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.629477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94ec2b-df37-47b8-969b-8658441f5a55 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.638642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 803/1610] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.638642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3dcb-0512-41bf-a062-31ab936f4b5b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.638642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3dcb-0512-41bf-a062-31ab936f4b5b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.638642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c3dcb-0512-41bf-a062-31ab936f4b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.658447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-914c3dcb-0512-41bf-a062-31ab936f4b5b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:14.659749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-914c3dcb-0512-41bf-a062-31ab936f4b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.668122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 804/1611] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.669749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.670036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.670312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.672485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 808/1612] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:14.674007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.674306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.674692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.705669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] MFA Rules not processed for user `eda7f9be6e924c6cba0a67cbb3c01052`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:14.706918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.724998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] MFA Rules not processed for user `8cb596917a57452f9e06d51f2bcecd25`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:14.726297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.800205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 809/1613] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.800205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.805972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 805/1614] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:14.807012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.811309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171afc9f-519c-471b-9b09-740d119c03cf None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.817321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.818697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.818697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.818957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.819736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.822001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.825935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d78c6-3294-4618-aa5e-21ccc7f1b9a6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.831865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.832899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.833845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.834959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.848435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.849998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.861879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 806/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:14.863010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.864416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:14.878303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd291c7-3781-4643-a573-4d7f4b603617 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:14.883385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:14.884010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:14.884288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:14.884559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:14.895457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:14.897196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:14.911101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 810/1616] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:14.911101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.915309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 807/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:14.917010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:14.926750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65f99-84e8-46f4-b1be-2f18f50f3c67 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.013008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196b84c-84a2-4a20-b424-53f5ecaae1bd admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.019080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.020074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.020596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.021081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.022039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.024742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.027076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.027792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.028082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.028414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.029069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.031159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.196342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 808/1618] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:15.197463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.202161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 811/1619] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:14 2022] POST /identity/v3/projects => generated 373 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:15.202161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.304883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321b35b-8e4d-48b4-8ec5-794bea6fe30a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.308472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f05257-326c-4f4a-87bc-09865c0689db admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.312160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.314347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.314347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.314561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.314749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.316879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.320087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.326392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.327684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.328070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.330307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.348459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.433306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 812/1620] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:15 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:15.436112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.446924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2643df-ab3f-47ce-890d-030018b33212 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.452757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.452966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.453583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.453583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.454098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.456035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.481939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 809/1621] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:15 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:15.483782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.494574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355501-813e-4006-8fe8-61b69f5773a2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.499639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.500536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.501324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.502071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.503312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.505315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.517928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 810/1622] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:15.519162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.538596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec456b-2062-4818-a213-3bfbff5ab98f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.548567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.549698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.550165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.550603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.551495 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.553584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.563531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 813/1623] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:15 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:15.570651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.570799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 811/1624] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:15.570799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.584025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80f464-ebc9-4d51-819b-691d284aa792 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.588518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c5772-af30-44d1-85f0-ba330cd45a91 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.594429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.595534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.596513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.596884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.597017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.597832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.598154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.599172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.599488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] PATH_INFO: `/v3/projects/b143e102b02b4f55bb958d99818db5a4/users/8a498719ac7641b2a2f19e6e935df191/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.600205 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.617896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 812/1625] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:15.619461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.633164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a2085-3891-4afd-a746-2f6f9bdb2f11 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.640561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.641606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.641889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.642160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] PATH_INFO: `/v3/projects/206180b7244742b687bd3a0365f5164a/users/1bcffb127ca843a6ac2a8b67a124222f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.654327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b143e102b02b4f55bb958d99818db5a4, user_id=8a498719ac7641b2a2f19e6e935df191, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.656960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.663948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206180b7244742b687bd3a0365f5164a, user_id=1bcffb127ca843a6ac2a8b67a124222f, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.666890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.752266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 813/1626] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:15 2022] PUT /identity/v3/projects/206180b7244742b687bd3a0365f5164a/users/1bcffb127ca843a6ac2a8b67a124222f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:15.756066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.761359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 814/1627] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:15 2022] PUT /identity/v3/projects/b143e102b02b4f55bb958d99818db5a4/users/8a498719ac7641b2a2f19e6e935df191/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:15.765597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.855428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348018-38cf-494e-8a19-8fdade0ae52b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.863201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.864429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.864952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.865465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.866581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.867251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe812007-9c53-471b-ba55-d7b4a9f1ccc0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.873874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.875056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.875713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.876172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] PATH_INFO: `/v3/projects/18139a4d2f7d42f7b98a0f27494add12/users/a6b9f074cba847cd9edd399d517c378d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.878443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.899283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 815/1628] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:15.901979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18139a4d2f7d42f7b98a0f27494add12, user_id=a6b9f074cba847cd9edd399d517c378d, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.905768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.906216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.926821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2418c-c907-400d-84c6-130a1a332a17 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.932393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.933343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.933820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.934368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.935285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.937186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:15.953557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 816/1629] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:15.954519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:15.965270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68591a-35b2-4dc3-9d39-0ff0f319d9bd admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:15.970973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:15.972061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:15.972425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:15.972784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] PATH_INFO: `/v3/projects/206180b7244742b687bd3a0365f5164a/users/1bcffb127ca843a6ac2a8b67a124222f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:15.977256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] RBAC: Authorizing `identity:create_grant(project_id=206180b7244742b687bd3a0365f5164a, user_id=1bcffb127ca843a6ac2a8b67a124222f, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:15.980351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.029595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 817/1631] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:15 2022] PUT /identity/v3/projects/206180b7244742b687bd3a0365f5164a/users/1bcffb127ca843a6ac2a8b67a124222f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:16.030079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 814/1631] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:15 2022] PUT /identity/v3/projects/18139a4d2f7d42f7b98a0f27494add12/users/a6b9f074cba847cd9edd399d517c378d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:16.030433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.032533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.141543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cb30c-3aa5-40f2-8057-5c3d8d92a843 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.170918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.173167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.173460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.173742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.179252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.180933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0a39-6aa9-4d56-b652-65ba4dbeb215 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.204752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151ffe3-6bec-4ca4-a9cd-bce81cfb446e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.211034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 815/1632] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:16.215210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a05bd-0450-4f1d-acc8-93b48191599e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.215990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a05bd-0450-4f1d-acc8-93b48191599e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.216335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a05bd-0450-4f1d-acc8-93b48191599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.231809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.232910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.233250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.233623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] PATH_INFO: `/v3/projects/b143e102b02b4f55bb958d99818db5a4/users/8a498719ac7641b2a2f19e6e935df191/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.238981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b143e102b02b4f55bb958d99818db5a4, user_id=8a498719ac7641b2a2f19e6e935df191, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.241768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.287738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 818/1633] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:16 2022] PUT /identity/v3/projects/b143e102b02b4f55bb958d99818db5a4/users/8a498719ac7641b2a2f19e6e935df191/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:16.289302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.299402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-fd8a05bd-0450-4f1d-acc8-93b48191599e None None] MFA Rules not processed for user `1bcffb127ca843a6ac2a8b67a124222f`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:16.300658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-fd8a05bd-0450-4f1d-acc8-93b48191599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:16.417921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0a3ce-8922-4a44-80ab-094bef730816 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.439041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.440503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.440975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.441287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] PATH_INFO: `/v3/projects/18139a4d2f7d42f7b98a0f27494add12/users/a6b9f074cba847cd9edd399d517c378d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.445547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 816/1634] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:16.446947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dbfe-1cc1-4680-8ec4-271215505f1e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.447242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dbfe-1cc1-4680-8ec4-271215505f1e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.447516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249dbfe-1cc1-4680-8ec4-271215505f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.454578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18139a4d2f7d42f7b98a0f27494add12, user_id=a6b9f074cba847cd9edd399d517c378d, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.457566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.489709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 819/1635] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:16 2022] PUT /identity/v3/projects/18139a4d2f7d42f7b98a0f27494add12/users/a6b9f074cba847cd9edd399d517c378d/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:16.490852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.496108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6249dbfe-1cc1-4680-8ec4-271215505f1e None None] MFA Rules not processed for user `8a498719ac7641b2a2f19e6e935df191`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:16.499489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6249dbfe-1cc1-4680-8ec4-271215505f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:16.568585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c07c7f-6bd3-4406-a7e5-cfd27405e1c9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.574049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.575613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.575912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.576241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.616916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 817/1636] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:16.618302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.619154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.619445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.660059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.661082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] MFA Rules not processed for user `a6b9f074cba847cd9edd399d517c378d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:16.662958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.663743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:16.679592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 820/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:16.681924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.769358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3664b67-37f7-4f45-bfab-2746f57a2e9e service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.769358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.769358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.769358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.770257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.807969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 818/1638] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:16.820343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.821910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.832741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 821/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:16.857776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:16.885314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9db47-2fe6-4b47-84de-39b0137e35d6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:16.896141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:16.898715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:16.899236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:16.899751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:16.926452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:16.928002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e14f2-2ea3-4bbd-a672-cc13996712a4 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:16.950983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 819/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:17.463487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:17.472170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414b8e3-8df5-449c-8937-2d8434d6ff0f service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:17.489214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:17.489889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:17.490170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:17.490441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:17.644700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:17.647151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb893c6-4c34-465d-a195-5acd63daca90 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:17.658519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 822/1641] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:17.868869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd7d6b-87df-42ff-ab70-c416a8ec2d24 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:17.869435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd7d6b-87df-42ff-ab70-c416a8ec2d24 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:17.869435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd7d6b-87df-42ff-ab70-c416a8ec2d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:17.934230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f6dd7d6b-87df-42ff-ab70-c416a8ec2d24 None None] MFA Rules not processed for user `a1f0b90b689143e79e005550c41d6484`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:17.935482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f6dd7d6b-87df-42ff-ab70-c416a8ec2d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:17.972529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6429-7b20-4056-b10e-adfce780b134 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:17.972896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6429-7b20-4056-b10e-adfce780b134 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:17.973686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f6429-7b20-4056-b10e-adfce780b134 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:17.975631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 823/1642] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 11 12:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 12:58:17.988975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb54b5-95c0-4763-bd2b-04f1a4c4fa9f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:17.990052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb54b5-95c0-4763-bd2b-04f1a4c4fa9f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:17.990052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb54b5-95c0-4763-bd2b-04f1a4c4fa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.026308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4edb54b5-95c0-4763-bd2b-04f1a4c4fa9f None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:18.028475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4edb54b5-95c0-4763-bd2b-04f1a4c4fa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:18.089928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 820/1643] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:18.103986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.110673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.111224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.172178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 824/1644] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 11 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:18.178783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cf124-7380-4b43-a2a8-25b1dcd1e364 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.179260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cf124-7380-4b43-a2a8-25b1dcd1e364 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.179650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cf124-7380-4b43-a2a8-25b1dcd1e364 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.184372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 825/1645] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 11 12:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:18.189070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23215db-02ac-4dea-9eee-0c3b7fcfa67a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.189489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23215db-02ac-4dea-9eee-0c3b7fcfa67a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.189879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23215db-02ac-4dea-9eee-0c3b7fcfa67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.200524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] MFA Rules not processed for user `a1f0b90b689143e79e005550c41d6484`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:18.203008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:18.224201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 821/1646] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:18.225221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:18.240520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b23215db-02ac-4dea-9eee-0c3b7fcfa67a None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:18.242352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b23215db-02ac-4dea-9eee-0c3b7fcfa67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:18.260185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aceeeb-9db7-4c80-9c86-e1197188c09a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:18.272621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:18.273692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.274369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.274843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.283935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 826/1647] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:18.294904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89cf9-10a7-4c05-a40d-0a7ba4dc9b6b None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.294904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89cf9-10a7-4c05-a40d-0a7ba4dc9b6b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.295253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89cf9-10a7-4c05-a40d-0a7ba4dc9b6b None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.296446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 827/1648] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 11 12:58:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:18.304133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.304465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.304712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.378456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:18.379976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:18.404479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 828/1649] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 11 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:18.412515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:18.430678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d0d93-c57a-45c6-a24b-9719ded949fe None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:18.452356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:18.453364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.454003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.454446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.468412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:18.470089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:18.471211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:18.473024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25963c6e-6a9a-4b9f-946d-d19fcc793971 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:18.483397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 822/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:18.484465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:18.513315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58ffb1-f733-4427-851e-0e260e6e796f service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:18.517295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:18.518101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.519382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.519568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 829/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:18.519824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.535979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:18.537779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d96c86-6421-4902-9eb2-239155fb69c7 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:18.551998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 823/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:18.910231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.911467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.911467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.912232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 830/1653] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 11 12:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:18.918669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0efa9-fce9-4709-81e9-d8f03e0be4c7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:18.919441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0efa9-fce9-4709-81e9-d8f03e0be4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:18.919560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0efa9-fce9-4709-81e9-d8f03e0be4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:18.946882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-baa0efa9-fce9-4709-81e9-d8f03e0be4c7 None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:18.948244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-baa0efa9-fce9-4709-81e9-d8f03e0be4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:18.961586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 824/1654] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:18.979146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:18.981198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:19.106449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed43f19-b498-40b0-8627-202d079d4a05 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:19.109493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:19.110161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:19.110448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:19.110730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:19.124153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:19.129647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc8334-45c3-4603-a54c-40099bb57fd1 service glance] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:19.167363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 831/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:20.042607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb9c7-fdec-4416-aa70-9843f531728d None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:20.042607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb9c7-fdec-4416-aa70-9843f531728d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:20.042607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb9c7-fdec-4416-aa70-9843f531728d None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:20.042607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 825/1656] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 11 12:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114d0b-3ec2-4c95-9d3f-19f00f539d4a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114d0b-3ec2-4c95-9d3f-19f00f539d4a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9114d0b-3ec2-4c95-9d3f-19f00f539d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d9114d0b-3ec2-4c95-9d3f-19f00f539d4a None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d9114d0b-3ec2-4c95-9d3f-19f00f539d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:20.054698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 832/1657] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:58:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:20.059776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb9c7-fdec-4416-aa70-9843f531728d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:20.059776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb9c7-fdec-4416-aa70-9843f531728d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:20.059776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:20.059776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:20.073013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:20.073013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:20.073013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:20.073013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c262e-3aa0-473b-a879-a0c6a45ade67 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:20.089425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 826/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:21.358959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e909a9-23fa-447c-b3e7-4d9bccb62d14 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:21.359903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e909a9-23fa-447c-b3e7-4d9bccb62d14 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:21.360378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e909a9-23fa-447c-b3e7-4d9bccb62d14 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:21.362345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 833/1659] 10.222.0.49 () {54 vars in 960 bytes} [Wed May 11 12:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:21.367924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:21.368445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:21.368516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:21.401463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] MFA Rules not processed for user `23d5c01936db49eea09a70c2c5852238`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:21.402888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:21.548952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 827/1660] 10.222.0.49 () {58 vars in 1057 bytes} [Wed May 11 12:58:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:21.558018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e909a9-23fa-447c-b3e7-4d9bccb62d14 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:21.589791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e909a9-23fa-447c-b3e7-4d9bccb62d14 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:21.612696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:21.613587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:21.614483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:21.625773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:21.625773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:21.686719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:21.688381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651697-89e3-4d5b-9e04-5718899dbb9e service placement] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:21.751893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 834/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:25.111214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:25.124297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4e744-78ae-4e96-8fc1-ff61a4e5a909 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:25.141892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:25.142656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:25.143024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:25.143464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:25.171359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:25.177615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a031e06-8d90-40ed-87b9-bfb1936e1102 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:25.202550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 828/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:27.113191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336128b3-dedc-48d1-9be8-e4e0f04fa6fa None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.113774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336128b3-dedc-48d1-9be8-e4e0f04fa6fa None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.113919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336128b3-dedc-48d1-9be8-e4e0f04fa6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:27.157263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-336128b3-dedc-48d1-9be8-e4e0f04fa6fa None None] MFA Rules not processed for user `da86fdd1a57d4a319f1158e76079ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:27.158750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-336128b3-dedc-48d1-9be8-e4e0f04fa6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:27.297761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de932-efe0-4e69-8578-19aebc976585 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.298270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de932-efe0-4e69-8578-19aebc976585 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.299674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de932-efe0-4e69-8578-19aebc976585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:27.329971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 835/1663] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:27.343584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.343979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.344358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:27.411033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-960de932-efe0-4e69-8578-19aebc976585 None None] MFA Rules not processed for user `f77d9e1f887e4b55ae8e982c00a735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:27.411807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] MFA Rules not processed for user `da86fdd1a57d4a319f1158e76079ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:27.413689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-960de932-efe0-4e69-8578-19aebc976585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:27.425425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:27.452412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 836/1664] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:27.460643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:27.493685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5eac9d-15d2-47c5-bac5-85e977cb4294 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:27.515765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:27.516964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.517491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.517962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:27.545703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:27.550829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:27.578542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 837/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:27.663903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 829/1666] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:27.838692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:27.859597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bac91-40f8-491b-980b-e6dbbc6b98c5 service nova] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:27.869350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:27.870023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.870317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.870591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:27.883985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:27.885668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943311d9-f373-4373-a57a-6b9f539e5861 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:27.910048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 838/1667] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:27.980064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-e987-4a93-af7f-b8ce1e691f82 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:27.980624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-e987-4a93-af7f-b8ce1e691f82 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:27.980880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e0f1-e987-4a93-af7f-b8ce1e691f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:28.047619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9cc8e0f1-e987-4a93-af7f-b8ce1e691f82 None None] MFA Rules not processed for user `e2074c33e19940eba5fc2ac957f5636a`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:28.049096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9cc8e0f1-e987-4a93-af7f-b8ce1e691f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:28.226802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 830/1668] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:28.384246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823c7e-de6d-4256-ba05-1dc120187a67 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:28.384747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823c7e-de6d-4256-ba05-1dc120187a67 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:28.385100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0823c7e-de6d-4256-ba05-1dc120187a67 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:28.387529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 839/1669] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 11 12:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:28.393541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:28.394024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:28.394101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:28.416446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:28.418308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:28.425150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 831/1670] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:28.439779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0823c7e-de6d-4256-ba05-1dc120187a67 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:28.456834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0823c7e-de6d-4256-ba05-1dc120187a67 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:28.461335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:28.461545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:28.462602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:28.463172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:28.463607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:28.474070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:28.475552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2ade7-a749-4376-9fd3-2ad5e6e8a500 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:28.476156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddbf17-f464-43bb-a4cf-dfed4a24716d service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:28.483092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:28.483831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:28.484124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:28.484552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:28.485947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 840/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:28.497827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:28.499869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a46dfe-7afb-46e2-8b67-b7477c6d4bc9 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:28.510288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 832/1672] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:29.231689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:29.232188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:29.232648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:29.264132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] MFA Rules not processed for user `da86fdd1a57d4a319f1158e76079ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:29.265504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:29.273877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 841/1673] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:29.548511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1edea-8811-4f19-b546-d37ccacbd5a5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:29.548944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1edea-8811-4f19-b546-d37ccacbd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:29.549144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1edea-8811-4f19-b546-d37ccacbd5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:29.596318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-63b1edea-8811-4f19-b546-d37ccacbd5a5 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:29.597610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-63b1edea-8811-4f19-b546-d37ccacbd5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:29.724134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 833/1674] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 12:58:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 11 12:58:30.214059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:30.216631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:30.386065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfec3f-d7b7-4b28-8434-ca470b2466b4 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:30.399219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:30.400032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:30.400372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:30.400699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:30.422939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:30.425877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cf75b-ab45-4173-9ce7-024c48ee1caa service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:30.447409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 842/1675] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 12:58:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 12:58:34.656181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aae54-e687-4f9e-ac45-a9868794c0b7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:34.656690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aae54-e687-4f9e-ac45-a9868794c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:34.656776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aae54-e687-4f9e-ac45-a9868794c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:34.684140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-414aae54-e687-4f9e-ac45-a9868794c0b7 None None] MFA Rules not processed for user `f77d9e1f887e4b55ae8e982c00a735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:34.693103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-414aae54-e687-4f9e-ac45-a9868794c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:34.706116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 834/1676] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:35.994329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:35.994329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:35.994329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:36.022196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] MFA Rules not processed for user `e2074c33e19940eba5fc2ac957f5636a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:36.025697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:36.049678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 843/1677] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:36.207087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57e28-5918-46fe-a127-27b8294875f3 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:36.207551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57e28-5918-46fe-a127-27b8294875f3 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:36.207551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57e28-5918-46fe-a127-27b8294875f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:36.227254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e1e57e28-5918-46fe-a127-27b8294875f3 None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:36.229639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e1e57e28-5918-46fe-a127-27b8294875f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:36.238625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 835/1678] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 11 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:36.290509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:36.308892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeacf64-b7e2-48dd-a3b7-ab61d17f64ba None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:36.333297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:36.337381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:36.337904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:36.338379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:36.348416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:36.350283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1e6fc-bfd2-4d03-8fe1-7fca80aa9a64 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:36.381600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 844/1679] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:38.571746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0522-f782-4227-b646-9115fab32d69 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:38.572269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0522-f782-4227-b646-9115fab32d69 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:38.572365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e0522-f782-4227-b646-9115fab32d69 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:38.574556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 836/1680] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:38.666893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:38.667996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:38.668820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:38.716826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:38.720368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:38.738382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 845/1681] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:58:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:38.884262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0522-f782-4227-b646-9115fab32d69 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:38.925064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e0522-f782-4227-b646-9115fab32d69 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:38.930683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:38.931342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:38.931638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:38.931917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:38.943018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:38.944681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c1552-a198-4c3a-b93e-e621ba0ed151 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:38.957129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 837/1682] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:40.836992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:40.898576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacada-68ce-4818-9853-a61d34d9cd1f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:40.903100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:40.904005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:40.904289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:40.904564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] PATH_INFO: `/v3/users/69d10c8e25734bc68c43a25c2de9510e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:40.905769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d10c8e25734bc68c43a25c2de9510e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:40.906785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: WARNING py.warnings [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:40.906785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: warnings.warn(msg) May 11 12:58:40.906785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: May 11 12:58:40.907992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:41.189001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d10c8e25734bc68c43a25c2de9510e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:41.189826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d10c8e25734bc68c43a25c2de9510e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:41.201367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d10c8e25734bc68c43a25c2de9510e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:41.268237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d10c8e25734bc68c43a25c2de9510e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:41.268794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d10c8e25734bc68c43a25c2de9510e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:41.293739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 846/1683] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:40 2022] DELETE /identity/v3/users/69d10c8e25734bc68c43a25c2de9510e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:41.298374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:41.298860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:41.298951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:41.315919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:41.317098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:41.374490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 838/1684] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:41.384305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:41.386458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:41.443277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465093-aff7-49b3-aaae-b3cddef90795 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:41.447036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:41.447690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:41.447977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:41.448800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:41.458145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:41.459600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501eb21-8a20-4673-bd4e-28dced34fd75 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:41.469470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 847/1685] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:41.881856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:41.883877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:41.896783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe62c76-c588-48e8-86eb-13b0703a91e7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:41.903950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:41.904791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:41.905692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:41.906124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] PATH_INFO: `/v3/projects/3aa75ac80d014d22b5ee5eac0eff01f1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:41.907782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa75ac80d014d22b5ee5eac0eff01f1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:41.908824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: WARNING py.warnings [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 12:58:41.908824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: warnings.warn(msg) May 11 12:58:41.908824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: May 11 12:58:41.910090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.121543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa75ac80d014d22b5ee5eac0eff01f1', 'request_id': 'req-859d9b3d-09bc-4fb4-9472-37c457db11c4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:42.134571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa75ac80d014d22b5ee5eac0eff01f1', 'request_id': 'req-859d9b3d-09bc-4fb4-9472-37c457db11c4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:42.251775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa75ac80d014d22b5ee5eac0eff01f1', 'request_id': 'req-859d9b3d-09bc-4fb4-9472-37c457db11c4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:42.297022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] The token cache is being invalidate because project 3aa75ac80d014d22b5ee5eac0eff01f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:42.297444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:42.301871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-859d9b3d-09bc-4fb4-9472-37c457db11c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:42.311394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 839/1686] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:41 2022] DELETE /identity/v3/projects/3aa75ac80d014d22b5ee5eac0eff01f1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:42.316969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.317572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.318210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.339714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:42.342415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:42.436621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 848/1687] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:42.446441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a932b-628f-4097-a088-b3a71433e05f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.446820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a932b-628f-4097-a088-b3a71433e05f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.447107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a932b-628f-4097-a088-b3a71433e05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.480043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-244a932b-628f-4097-a088-b3a71433e05f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:42.481960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-244a932b-628f-4097-a088-b3a71433e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:42.501867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 840/1688] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:42.505936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.521608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219c675-8f7c-43ca-bdac-79a5a366899d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.527280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.528637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.529009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.529478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.530229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:42.530546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:42.532252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.566879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 849/1689] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:58:42.570701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a932b-628f-4097-a088-b3a71433e05f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.582925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a932b-628f-4097-a088-b3a71433e05f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.588506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.589339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.589653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.589963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.591208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:42.593392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.684608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 841/1690] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:42 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:42.685976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.703333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2708ff-57b8-4ed7-a1e4-bc8dded0d2a7 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.786301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.786301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.786301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.786301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.786596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:42.789575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.873236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 850/1691] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:42 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:42.877531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.895298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b13f-0cc5-4f56-a66e-6c5a363ee740 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.900951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.901894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.902376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.903516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.904472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:42.906441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.917860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 842/1692] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:42.922072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.933429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1ee27-fa68-4b8d-94c2-0e66769c00f1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.939710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.940694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.941002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.941323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.943132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:42.944981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7e9ad-1e38-4a86-ad9f-57720367bf07 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:42.962824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 851/1693] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:42.963210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:42.975929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cade3a-f60d-495e-a8a9-203c46720ebf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:42.981097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:42.982240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:42.982528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:42.982827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] PATH_INFO: `/v3/projects/4557f95b1b2c450f8fbce3d66760d778/users/b8578bcf27674d11a5b2bc9c5fd63903/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:42.999070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4557f95b1b2c450f8fbce3d66760d778, user_id=b8578bcf27674d11a5b2bc9c5fd63903, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:43.001900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:43.107104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 843/1694] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:42 2022] PUT /identity/v3/projects/4557f95b1b2c450f8fbce3d66760d778/users/b8578bcf27674d11a5b2bc9c5fd63903/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:43.118191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:43.118484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:43.118764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:43.163406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] MFA Rules not processed for user `b8578bcf27674d11a5b2bc9c5fd63903`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:43.164996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:43.407008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 852/1695] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:43.409793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:43.549449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c21874-c4b5-4841-a051-92f2c2350c5e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:43.557196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:43.558073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:43.558509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:43.558978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:43.559824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:43.563510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:43.679035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 844/1696] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:43 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:43.705750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:43.722713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530a32-505e-4765-b227-e06a8b37fbae None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:43.786483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:43.787256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:43.787571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:43.787847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:43.788722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:43.791367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.092230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 853/1697] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:43 2022] POST /identity/v3/users => generated 288 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:44.094809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.106992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638bba7-c258-44e1-b9c9-df05435a6cbd admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.112698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.113539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.113828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.114106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.114913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.116867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.140918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 845/1698] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:44.142126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.154840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731c09-7156-4a9a-afdf-4660a329bae6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.160517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.161568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.161924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.162453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] PATH_INFO: `/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd/users/bc88258215064d23bd338906d20d3d89/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.178939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab820e3eb7bb4a3f8dcad39a3d8005bd, user_id=bc88258215064d23bd338906d20d3d89, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.182568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.268012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 854/1699] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:44 2022] PUT /identity/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd/users/bc88258215064d23bd338906d20d3d89/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:44.271846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.285149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a477b4-3af1-4978-bb8b-ee95b97427b2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.311468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.314155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:44.418697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81056-f730-4e7d-a8b2-bb0000b81ff9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.424983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.426024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.426315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.426600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.427364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.429124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.441903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.444193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.444332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 846/1700] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:44.444415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.444415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] PATH_INFO: `/v3/users/be0acb3806f647dba73cf6bb9bf55267` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.445332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0acb3806f647dba73cf6bb9bf55267)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.454274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.460751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.480318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d53e6-84ac-4c40-af4d-0b38187909db admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.495107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.496025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.496361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.497617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] PATH_INFO: `/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd/users/bc88258215064d23bd338906d20d3d89/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.500020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab820e3eb7bb4a3f8dcad39a3d8005bd, user_id=bc88258215064d23bd338906d20d3d89, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.503028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed9c1-e0c3-48f7-853f-3fb8e1712868 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.518498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 847/1701] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:44 2022] PUT /identity/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd/users/bc88258215064d23bd338906d20d3d89/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:44.536324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.536928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.537444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.589475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] MFA Rules not processed for user `bc88258215064d23bd338906d20d3d89`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:44.592178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:44.713642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 848/1702] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:44.731168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0acb3806f647dba73cf6bb9bf55267'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:44.732071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0acb3806f647dba73cf6bb9bf55267'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:44.736632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:44.739624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:44.745979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0acb3806f647dba73cf6bb9bf55267'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:44.807054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0acb3806f647dba73cf6bb9bf55267'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:44.810252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e15cd7c6-0330-40b8-bbda-e552e0a232db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0acb3806f647dba73cf6bb9bf55267'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:44.844143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123b94-ce79-4420-a596-79e19f8b988a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:44.848477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:44.849380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.849821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.850245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.853061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:44.854521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 855/1703] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:44 2022] DELETE /identity/v3/users/be0acb3806f647dba73cf6bb9bf55267 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:44.856032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:44.856344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:44.856658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:44.869584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:44.871863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:44.891119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 849/1704] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:44.900757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:44.902023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:45.006722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 856/1705] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:45.030899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:45.041781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:45.133956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3569f1b-b47c-49cf-a2c9-eb7825de43b9 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:45.192456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:45.197226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:45.197226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:45.197226 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:45.203985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:45.205811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:45.217168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 850/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:45.768696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:45.770192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:45.782934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44737f-1df7-4df0-b254-b32389fcbb6a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:45.788176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:45.789398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:45.789571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:45.789834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] PATH_INFO: `/v3/projects/4075bd7b7de04b7b89f2d5e9230faddd` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:45.791216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4075bd7b7de04b7b89f2d5e9230faddd)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:45.794157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:45.974315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4075bd7b7de04b7b89f2d5e9230faddd', 'request_id': 'req-329ac886-38c5-4f8d-bc3d-358ce7241495'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:45.979534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4075bd7b7de04b7b89f2d5e9230faddd', 'request_id': 'req-329ac886-38c5-4f8d-bc3d-358ce7241495'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:45.988314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:45.991392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:46.003993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35126-dce1-48aa-9160-c6462d6c10ef service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:46.062716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4075bd7b7de04b7b89f2d5e9230faddd', 'request_id': 'req-329ac886-38c5-4f8d-bc3d-358ce7241495'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.066118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:46.073346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:46.073346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:46.073346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] PATH_INFO: `/v3/users/b8578bcf27674d11a5b2bc9c5fd63903` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:46.073346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8578bcf27674d11a5b2bc9c5fd63903)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:46.073346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:46.080728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] The token cache is being invalidate because project 4075bd7b7de04b7b89f2d5e9230faddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:46.081324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.082089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.089068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 857/1707] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:45 2022] DELETE /identity/v3/projects/4075bd7b7de04b7b89f2d5e9230faddd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:46.093579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:46.095170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:46.107586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac886-38c5-4f8d-bc3d-358ce7241495 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:46.112395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:46.113377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:46.113823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:46.114104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] PATH_INFO: `/v3/users/1bcffb127ca843a6ac2a8b67a124222f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:46.115313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcffb127ca843a6ac2a8b67a124222f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:46.117263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:46.310897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8578bcf27674d11a5b2bc9c5fd63903'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.317357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8578bcf27674d11a5b2bc9c5fd63903'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.318019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8578bcf27674d11a5b2bc9c5fd63903'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.367928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcffb127ca843a6ac2a8b67a124222f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.368621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcffb127ca843a6ac2a8b67a124222f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.376142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcffb127ca843a6ac2a8b67a124222f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.385190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8578bcf27674d11a5b2bc9c5fd63903'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.385809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fdc05718-ec57-4276-b366-2aa4bd2b93aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8578bcf27674d11a5b2bc9c5fd63903'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.406624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 851/1708] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:45 2022] DELETE /identity/v3/users/b8578bcf27674d11a5b2bc9c5fd63903 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:58:46.411008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:46.411300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:46.411586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:46.429102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:46.430305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:46.454478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcffb127ca843a6ac2a8b67a124222f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.455204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcffb127ca843a6ac2a8b67a124222f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:46.476046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 858/1709] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:46 2022] DELETE /identity/v3/users/1bcffb127ca843a6ac2a8b67a124222f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:58:46.492611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 852/1710] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:46.507951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:46.509399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:46.569211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb40fc-dc9d-465a-86bb-e37ac7bf9b09 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:46.572835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:46.573527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:46.573816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:46.574095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:46.633552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:46.634999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:46.646286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 859/1711] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:46.976983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:46.978498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:46.990452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3cca2-54f6-4636-a183-e58c55fff817 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:46.995001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:46.995920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:46.996776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:46.997077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] PATH_INFO: `/v3/projects/206180b7244742b687bd3a0365f5164a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:46.998672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=206180b7244742b687bd3a0365f5164a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.000604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.107526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206180b7244742b687bd3a0365f5164a', 'request_id': 'req-0f07534d-fead-43b1-8265-a2f885399228'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.117536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206180b7244742b687bd3a0365f5164a', 'request_id': 'req-0f07534d-fead-43b1-8265-a2f885399228'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.126416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.128383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.142158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40117d-cc65-4b58-b853-f9fe9da9c72d service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.201162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206180b7244742b687bd3a0365f5164a', 'request_id': 'req-0f07534d-fead-43b1-8265-a2f885399228'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.215079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.220964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.220964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.220964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] PATH_INFO: `/v3/projects/4557f95b1b2c450f8fbce3d66760d778` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.220964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4557f95b1b2c450f8fbce3d66760d778)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.221344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] The token cache is being invalidate because project 206180b7244742b687bd3a0365f5164a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:47.221344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.221506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.221596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0f07534d-fead-43b1-8265-a2f885399228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.222800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 853/1712] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:46 2022] DELETE /identity/v3/projects/206180b7244742b687bd3a0365f5164a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:47.227588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542be3c-90d8-424d-8af6-86c0f1232f86 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.228064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542be3c-90d8-424d-8af6-86c0f1232f86 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.228509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542be3c-90d8-424d-8af6-86c0f1232f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.248367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3542be3c-90d8-424d-8af6-86c0f1232f86 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:47.249602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3542be3c-90d8-424d-8af6-86c0f1232f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.257803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 854/1713] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:47.266461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487284-7251-4689-8c92-ffadea820832 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.266756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487284-7251-4689-8c92-ffadea820832 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.267044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487284-7251-4689-8c92-ffadea820832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.285200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-34487284-7251-4689-8c92-ffadea820832 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:47.289800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-34487284-7251-4689-8c92-ffadea820832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.294900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 855/1714] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:47.298955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487284-7251-4689-8c92-ffadea820832 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.307698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487284-7251-4689-8c92-ffadea820832 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.312902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.313581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.313866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.314147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.314872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:47.315180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.316776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.326398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4557f95b1b2c450f8fbce3d66760d778', 'request_id': 'req-27c9da7a-a70a-49dd-957a-495759517442'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.328652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 856/1715] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:58:47.331983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4557f95b1b2c450f8fbce3d66760d778', 'request_id': 'req-27c9da7a-a70a-49dd-957a-495759517442'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.332842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.343109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc3b8e-1f74-49b7-8c2a-9a7698298f10 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.397423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.398108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.398388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.398657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.399373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.401462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.402440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4557f95b1b2c450f8fbce3d66760d778', 'request_id': 'req-27c9da7a-a70a-49dd-957a-495759517442'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.414287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] The token cache is being invalidate because project 4557f95b1b2c450f8fbce3d66760d778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:47.414581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.415246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.416814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 860/1716] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:47 2022] DELETE /identity/v3/projects/4557f95b1b2c450f8fbce3d66760d778 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:47.421755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.423074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.435409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9da7a-a70a-49dd-957a-495759517442 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.440150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.441005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.441368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.442486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] PATH_INFO: `/v3/users/bc88258215064d23bd338906d20d3d89` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.442875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc88258215064d23bd338906d20d3d89)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.444810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.511391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 857/1717] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:47 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:58:47.515850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.517513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.583537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cde4e-bf67-4b55-94f8-90dca020496c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.588445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.589155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.589445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.589730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.590421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.592391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.616504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc88258215064d23bd338906d20d3d89'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.617132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc88258215064d23bd338906d20d3d89'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.624383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc88258215064d23bd338906d20d3d89'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.669144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 858/1718] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:47 2022] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:47.673151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.682371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7655-1040-4703-b1a7-47402d7d486c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.687262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.688037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.688323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.688602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.689366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.690998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.691273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc88258215064d23bd338906d20d3d89'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.691916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc88258215064d23bd338906d20d3d89'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:47.701285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 859/1719] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:47.705277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.707009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:47.710676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 861/1720] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:47 2022] DELETE /identity/v3/users/bc88258215064d23bd338906d20d3d89 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:58:47.723438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73633ce2-bc3f-4cb8-b645-80d6a90b062b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.782152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.782839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.783134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.783414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.784200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.785859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97cec4-7264-4a5d-9c5c-9ceaefe7b8b2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.796889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 860/1721] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:47.801319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:47.812551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baa24f-88fa-4c16-883d-2f76c7c1db79 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:47.817890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:47.820938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.820938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.820938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] PATH_INFO: `/v3/projects/e777450b62424d60a44d07177c5d5c02/users/3e86812480564167b70dafa7c5ddec8e/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.836038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e777450b62424d60a44d07177c5d5c02, user_id=3e86812480564167b70dafa7c5ddec8e, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:47.838752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:47.930739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 862/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:47 2022] PUT /identity/v3/projects/e777450b62424d60a44d07177c5d5c02/users/3e86812480564167b70dafa7c5ddec8e/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:47.932975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:47.933490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:47.933960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:47.976992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] MFA Rules not processed for user `3e86812480564167b70dafa7c5ddec8e`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:47.978449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:48.050405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 861/1723] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:48.054632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.118262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568204a0-5ea2-4e83-9884-b72bdc48565e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.123065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.123727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.124066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.124295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.124988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.126920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.172613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.174212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:48.188930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158ece-cfed-4041-97b6-46bf11269b03 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.193590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.194463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.194787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.197845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] PATH_INFO: `/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.197845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab820e3eb7bb4a3f8dcad39a3d8005bd)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.198420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.267751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 863/1724] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:48.273655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.348571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab820e3eb7bb4a3f8dcad39a3d8005bd', 'request_id': 'req-383b22b0-574b-48f5-97cf-7d35b1479a4e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:48.357659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab820e3eb7bb4a3f8dcad39a3d8005bd', 'request_id': 'req-383b22b0-574b-48f5-97cf-7d35b1479a4e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:48.406963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f40b17-4ef4-4354-a2dc-4ebb10b90cae admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.468699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab820e3eb7bb4a3f8dcad39a3d8005bd', 'request_id': 'req-383b22b0-574b-48f5-97cf-7d35b1479a4e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:48.500724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] The token cache is being invalidate because project ab820e3eb7bb4a3f8dcad39a3d8005bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:48.500724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:48.506293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-383b22b0-574b-48f5-97cf-7d35b1479a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:48.508421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 862/1725] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:48 2022] DELETE /identity/v3/projects/ab820e3eb7bb4a3f8dcad39a3d8005bd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:58:48.513586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2eecc-3d04-4765-90e6-c6cce112ab11 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.514098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2eecc-3d04-4765-90e6-c6cce112ab11 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.515912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2eecc-3d04-4765-90e6-c6cce112ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.517344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.518025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.518312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.518610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.519323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.537055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.558278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-70f2eecc-3d04-4765-90e6-c6cce112ab11 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:48.560757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-70f2eecc-3d04-4765-90e6-c6cce112ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:48.600197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 863/1726] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:48.602643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.606137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.608089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.651794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:48.653892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:48.655245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 864/1727] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/users => generated 289 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:48.660784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.667444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 864/1728] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:48.667683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:48.677456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.698044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802190c-55f0-4167-b156-6116d4d357a3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.703372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d585af5-c8a2-4de2-b028-21703eabaf8b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.708736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.709466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.709793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.710067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.714934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.715112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.715208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.715208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.715208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.715460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.717384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:58:48.717776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.719502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.736379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 865/1729] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:58:48.740481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.751685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 865/1730] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:48.754227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.756928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe99d8-34ec-4153-835b-4dfa4d379f5a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.770342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.772663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.772663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.772663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.773349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.774041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a4c07-0d79-40ce-83c1-e17cd6b83fdf admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:48.775980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.779403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:48.780299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:48.780597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:48.780854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] PATH_INFO: `/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0/users/cc233608a2394d8f8643116f2a274ada/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:48.814961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b8669292eb4558a8d1a63f6ce80ea0, user_id=cc233608a2394d8f8643116f2a274ada, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:48.817743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:48.916366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 866/1731] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:48.917511 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:48.943024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 866/1732] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:48 2022] PUT /identity/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0/users/cc233608a2394d8f8643116f2a274ada/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:48.947455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.006187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910bea6-cfc5-439a-b4f5-55ad31083263 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.086034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f69e-46d0-4b44-9106-5f55517d2e54 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.102206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.102206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.102206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.102206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.102520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.102520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.102520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.103095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.103172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.104828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.106302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.114673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.117515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 867/1733] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:49.122484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.158871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de8651-96a5-47f3-bd9b-44c4edf60a2a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.185313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.191755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.192165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.197918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] PATH_INFO: `/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0/users/cc233608a2394d8f8643116f2a274ada/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.203993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b8669292eb4558a8d1a63f6ce80ea0, user_id=cc233608a2394d8f8643116f2a274ada, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.206969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa38d9b-6f7c-4977-b243-a34d41a4191d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.235537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 868/1734] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:49 2022] PUT /identity/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0/users/cc233608a2394d8f8643116f2a274ada/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:58:49.253689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.254456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.255442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.277330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 867/1735] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:48 2022] POST /identity/v3/users => generated 282 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:49.280470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.297668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6a8e1-52d0-4380-a7f3-e9009a92af54 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.312876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] MFA Rules not processed for user `cc233608a2394d8f8643116f2a274ada`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:49.314202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:49.394243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.395527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.396138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.398110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.399151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.401439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.429249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 868/1736] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:49.429724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 869/1737] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:49.446359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.449919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.451910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:49.460568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b130b6c-da19-47b2-b830-5446e21f6fee admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.467021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.467979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.468496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.469249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.470469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.472960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.490413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 869/1738] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:49.493671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.506360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7d37-cb87-4184-a97d-b09ac98460d6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.512865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.515660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.515660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.515660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] PATH_INFO: `/v3/projects/96eb293a8f6b43cba5f2f83310d0bf1a/users/b0d6f1d7a4514d338741de687eff9d61/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.552833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96eb293a8f6b43cba5f2f83310d0bf1a, user_id=b0d6f1d7a4514d338741de687eff9d61, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.560630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.587973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a6c4f-1d42-4794-bbec-0e9cc143499e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:49.592109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:49.593486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.593782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.594062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.606180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:49.608334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f38800-9391-4ac9-8287-524c899d0ebd service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:49.618355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 870/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:58:49.685699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 870/1740] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:49 2022] PUT /identity/v3/projects/96eb293a8f6b43cba5f2f83310d0bf1a/users/b0d6f1d7a4514d338741de687eff9d61/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:49.689097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:49.689416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:49.689705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:49.729877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] MFA Rules not processed for user `b0d6f1d7a4514d338741de687eff9d61`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:49.731765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:49.868554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 871/1741] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:49.873674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:49.915479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.014404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784d63b-91ee-4667-88bb-dc11742a2d53 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.026065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.026809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.027192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.028267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.034300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:50.044066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e76e1-cb53-4e2c-8983-db032f23bd1d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.069306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.070153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.070556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.070932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.071936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.074502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.144157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.146192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.157593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 872/1742] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:50.236337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 871/1743] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:58:49 2022] POST /identity/v3/projects => generated 365 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:58:50.239922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.259848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736238-d346-440a-a283-77f207e4d204 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.390672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.391370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.391657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.391930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.392742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.394621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.585017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 873/1744] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:58:50 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:58:50.587311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.599993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ded91-9b68-4281-9463-d26a36af3689 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.604634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.605908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.606329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.606832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.607926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.609842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.620490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 872/1745] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:58:50.625619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.635654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739150a-4192-487d-be65-eccc20e3900f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.642537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.643417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.643783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.645369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] PATH_INFO: `/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13/users/81df121441cb4a3296763d76724e91ce/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.662138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2e7e52a3274dbe9f5682addcc84c13, user_id=81df121441cb4a3296763d76724e91ce, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.664821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.816507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 874/1746] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:50 2022] PUT /identity/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13/users/81df121441cb4a3296763d76724e91ce/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:50.820682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.838050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0c2e-6eb7-4610-ae5b-406326714ef5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.923243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.924102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.924292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.924530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.925474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.927401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d10e6-a1a7-474b-b3fd-6348a97d1c97 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:50.953977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 873/1747] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:58:50.958589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:50.974611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d269adc-3b3c-402f-85d6-d8e9dfae75a1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:50.982138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:50.983374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:50.983796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:50.984704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] PATH_INFO: `/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13/users/81df121441cb4a3296763d76724e91ce/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:50.989146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2e7e52a3274dbe9f5682addcc84c13, user_id=81df121441cb4a3296763d76724e91ce, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:50.992623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:51.010605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 875/1748] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:58:50 2022] PUT /identity/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13/users/81df121441cb4a3296763d76724e91ce/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:51.024110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:51.025074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:51.025359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:51.078388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] MFA Rules not processed for user `81df121441cb4a3296763d76724e91ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:51.079633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:51.183218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 874/1749] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:51.201737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:51.270210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064350f2-116f-4aa9-867d-13650da7f3b7 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:51.276061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:51.276061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:51.276061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:51.276061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:51.300700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:51.316612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:51.321225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 876/1750] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:51.717602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:51.719211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:51.731133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f961-7275-4f6f-8949-ae0c57172f00 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:51.735105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:51.735841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:51.736218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:51.736564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:51.806012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:51.807603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4c43e-3d9f-4a67-ba43-f52a6e56d962 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:51.819560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 875/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:56.767670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:56.864679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e6fd6-7456-4afa-a08a-4b82575ef5cd service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:56.872068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:56.873248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:56.873696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:56.874108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] PATH_INFO: `/v3/users/b0d6f1d7a4514d338741de687eff9d61` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:56.876001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d6f1d7a4514d338741de687eff9d61)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:56.879167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:57.132913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d6f1d7a4514d338741de687eff9d61'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:57.133948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d6f1d7a4514d338741de687eff9d61'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:57.151241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d6f1d7a4514d338741de687eff9d61'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:57.254641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d6f1d7a4514d338741de687eff9d61'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:57.255319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d6f1d7a4514d338741de687eff9d61'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:57.289224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 877/1752] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:56 2022] DELETE /identity/v3/users/b0d6f1d7a4514d338741de687eff9d61 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:57.294141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395063-449c-49be-9dd2-f28de014ff6b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:57.294655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395063-449c-49be-9dd2-f28de014ff6b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:57.294740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395063-449c-49be-9dd2-f28de014ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:57.320176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f5395063-449c-49be-9dd2-f28de014ff6b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:57.320343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f5395063-449c-49be-9dd2-f28de014ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:57.444335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 876/1753] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:58:57.463125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:57.463125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:57.612950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21973e4-1200-401d-87e1-38deb4a0583a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:57.618925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:57.620161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:57.620514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:57.624310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:57.632422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:57.634020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37706b13-d2d5-4ca7-983f-cf8ea5867023 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:57.662499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 878/1754] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:57.895802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:57.896262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:57.896653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:57.898215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 877/1755] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:58:57.906768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:57.907629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:57.909569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:57.943409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:58:57.947578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:58.154531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 879/1756] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:58:58.418819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:58.425806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:58.447903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a38e50-5c66-442f-acbc-b10914ab2d4f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:58.458192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:58.458935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:58.459225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:58.459526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:58.469591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:58.471204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:58.485237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 878/1757] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:58:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:58:58.870044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:58.872197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:58.889641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3746be-aca8-47ca-85f0-9510430f19de None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:58.892416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:58.893326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:58.893770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:58.894055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] PATH_INFO: `/v3/projects/96eb293a8f6b43cba5f2f83310d0bf1a` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:58.895265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96eb293a8f6b43cba5f2f83310d0bf1a)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:58.897235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:58.997205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96eb293a8f6b43cba5f2f83310d0bf1a', 'request_id': 'req-fee03e61-0ade-4659-8632-243dd100a196'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.003998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96eb293a8f6b43cba5f2f83310d0bf1a', 'request_id': 'req-fee03e61-0ade-4659-8632-243dd100a196'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.067798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96eb293a8f6b43cba5f2f83310d0bf1a', 'request_id': 'req-fee03e61-0ade-4659-8632-243dd100a196'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.079174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] The token cache is being invalidate because project 96eb293a8f6b43cba5f2f83310d0bf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:58:59.079458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.080083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.081658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 880/1758] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:58 2022] DELETE /identity/v3/projects/96eb293a8f6b43cba5f2f83310d0bf1a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:59.085797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:59.096314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860708d-f3b4-4d48-bab4-60201b965728 service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:59.150442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:59.151236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:59.151520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:59.152300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] PATH_INFO: `/v3/users/81df121441cb4a3296763d76724e91ce` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:59.153513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=81df121441cb4a3296763d76724e91ce)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:59.155456 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:58:59.379640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81df121441cb4a3296763d76724e91ce'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.385367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81df121441cb4a3296763d76724e91ce'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.386424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81df121441cb4a3296763d76724e91ce'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.448538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81df121441cb4a3296763d76724e91ce'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.449685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d320434e-c39b-424d-99cc-80c640046c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81df121441cb4a3296763d76724e91ce'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:58:59.470068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 879/1759] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:58:59 2022] DELETE /identity/v3/users/81df121441cb4a3296763d76724e91ce => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:58:59.905025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:58:59.906666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:58:59.919869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee03e61-0ade-4659-8632-243dd100a196 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:58:59.991815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:58:59.992679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:58:59.992967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:58:59.993272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] PATH_INFO: `/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:58:59.994454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2e7e52a3274dbe9f5682addcc84c13)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:58:59.996389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.126838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2e7e52a3274dbe9f5682addcc84c13', 'request_id': 'req-d8cbfe18-c4ad-4003-995b-59f1169d4835'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:00.132142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2e7e52a3274dbe9f5682addcc84c13', 'request_id': 'req-d8cbfe18-c4ad-4003-995b-59f1169d4835'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:00.173282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2e7e52a3274dbe9f5682addcc84c13', 'request_id': 'req-d8cbfe18-c4ad-4003-995b-59f1169d4835'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:00.184567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] The token cache is being invalidate because project ba2e7e52a3274dbe9f5682addcc84c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:00.184897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:00.185570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d8cbfe18-c4ad-4003-995b-59f1169d4835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:00.187098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 881/1760] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:58:59 2022] DELETE /identity/v3/projects/ba2e7e52a3274dbe9f5682addcc84c13 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:00.192163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.192459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.192741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.210154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:00.211350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:00.270927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 880/1761] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:00.278847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.279138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.279418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.297817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:00.299027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:00.306742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 882/1762] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:00.311473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.321105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e196a-9dda-408b-871e-ce32ab7add31 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.325779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.326485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.326768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.327046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.327767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:00.328078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.329718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.341132 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 881/1763] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:00.349187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.360047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6aec2-4c8d-4460-8e22-e863a198bb13 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.364730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.365412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.365695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.365968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.366656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.368531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.452413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 883/1764] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:00 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:00.456725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.467531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d866a-035a-4946-9672-91b7449d1808 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.522761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.523444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.523727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.524004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.524699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.527308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.631817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 882/1765] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:00 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:00.635876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.648000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071edda-205d-44e1-a1c6-a101b3021b9b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.652915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.653634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.653922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.654203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.654935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.656767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.670287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 884/1766] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:00.677867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.691153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcc88f-a5bf-49e5-81de-997696f07092 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.703980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.705225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.705383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.705943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.706740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.708514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04970cbd-21eb-42b4-a76c-9309418305b5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.723273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 883/1767] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:00.727358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:00.737680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0458b4b-eb0b-455d-986c-232db7cabf48 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:00.743280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:00.744294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.744588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.744870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] PATH_INFO: `/v3/projects/197c59b0e8de43309694b7dd5c9e5253/users/5437f4a9474d461b91c91dafc2be5202/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.765766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197c59b0e8de43309694b7dd5c9e5253, user_id=5437f4a9474d461b91c91dafc2be5202, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:00.768530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:00.859170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 885/1768] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:00 2022] PUT /identity/v3/projects/197c59b0e8de43309694b7dd5c9e5253/users/5437f4a9474d461b91c91dafc2be5202/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:00.869607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:00.869991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:00.870454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:00.915798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] MFA Rules not processed for user `5437f4a9474d461b91c91dafc2be5202`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:00.917952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:01.067238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 884/1769] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:01.068918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.191161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b7a1f-0c6c-446a-a8df-70a047c15115 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.197169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.200006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.200006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.200006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.200006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.201900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.397353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 886/1770] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:01 2022] POST /identity/v3/projects => generated 381 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:01.401566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.412604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42a61a-4370-4c29-9062-9c20ae9224d0 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.467731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.468417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.468693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.468970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.469699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.471699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.556151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 885/1771] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:01 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:01.563718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.570312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbb5e5-6f0e-4b6e-973c-09ff719f21a2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.575780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.576437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.576718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.576991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.577738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.579319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.590499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 887/1772] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:01.594642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.604671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fad22-aa69-4125-bdc9-44141c913f7f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.610148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.611034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.611311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.611580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] PATH_INFO: `/v3/projects/b069a7a2f7d84b11a61a14ecc643a531/users/eb4d33195aaf416583b7be2f3a2aead7/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.627693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b069a7a2f7d84b11a61a14ecc643a531, user_id=eb4d33195aaf416583b7be2f3a2aead7, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.630422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.713549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 886/1773] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:01 2022] PUT /identity/v3/projects/b069a7a2f7d84b11a61a14ecc643a531/users/eb4d33195aaf416583b7be2f3a2aead7/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:01.718228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.728199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57d28c-89b1-4924-9c68-098be7cb6e4d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.801836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.801836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.801836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.801836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.802256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.802256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709167b-4cf4-4faf-a0b1-a7e7ea01db9b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.816187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 888/1774] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:01.817448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:01.837373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38039212-823e-42c9-843c-7283d8a27a1a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:01.848747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:01.849327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.849613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.849880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] PATH_INFO: `/v3/projects/b069a7a2f7d84b11a61a14ecc643a531/users/eb4d33195aaf416583b7be2f3a2aead7/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.857928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b069a7a2f7d84b11a61a14ecc643a531, user_id=eb4d33195aaf416583b7be2f3a2aead7, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:01.873144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:01.890491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 887/1775] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:01 2022] PUT /identity/v3/projects/b069a7a2f7d84b11a61a14ecc643a531/users/eb4d33195aaf416583b7be2f3a2aead7/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:01.901949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344843e6-31a0-421b-9505-f89734572e14 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:01.902382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344843e6-31a0-421b-9505-f89734572e14 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:01.902680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344843e6-31a0-421b-9505-f89734572e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:01.936674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-344843e6-31a0-421b-9505-f89734572e14 None None] MFA Rules not processed for user `eb4d33195aaf416583b7be2f3a2aead7`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:01.938468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-344843e6-31a0-421b-9505-f89734572e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:02.059454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 889/1776] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:02.070269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:02.073022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:02.169478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56013d52-4195-4433-8b11-556d94846aeb admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:02.175551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:02.176235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:02.179989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:02.179989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:02.189122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:02.190601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:02.226545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 888/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:03.401157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344843e6-31a0-421b-9505-f89734572e14 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:03.412458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344843e6-31a0-421b-9505-f89734572e14 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:03.420635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4d33195aaf416583b7be2f3a2aead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b069a7a2f7d84b11a61a14ecc643a531', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:03.421348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:03.421636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:03.421920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:03.422656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:03.423114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:03.424717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:03.438069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 890/1778] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:03.442268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:03.451498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5be51-391f-4213-9a79-417052c3705f service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:03.456198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4d33195aaf416583b7be2f3a2aead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b069a7a2f7d84b11a61a14ecc643a531', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:03.456853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:03.457178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:03.457450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:03.458278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:03.460169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:03.578076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 889/1779] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:03 2022] POST /identity/v3/projects => generated 354 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:03.582164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:03.592766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e27959-9371-4995-b210-d5ff89172515 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:03.655110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4d33195aaf416583b7be2f3a2aead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b069a7a2f7d84b11a61a14ecc643a531', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:03.655719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:03.656015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:03.656291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:03.657022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:03.657361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:03.658963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:03.671970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 891/1780] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:59:03.724028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:03.734334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6990e-a6c5-4968-9432-17217f878a52 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:03.738898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb4d33195aaf416583b7be2f3a2aead7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b069a7a2f7d84b11a61a14ecc643a531', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:03.739752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:03.740073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:03.740341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] PATH_INFO: `/v3/projects/7c8ea9b11c4644bf9aa9e06f8a363119` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:03.741545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7c8ea9b11c4644bf9aa9e06f8a363119)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:03.743441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:03.841509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8ea9b11c4644bf9aa9e06f8a363119', 'request_id': 'req-985b1b6f-6abe-400e-9bd2-e477a72a815c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:03.846855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8ea9b11c4644bf9aa9e06f8a363119', 'request_id': 'req-985b1b6f-6abe-400e-9bd2-e477a72a815c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:03.899681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8ea9b11c4644bf9aa9e06f8a363119', 'request_id': 'req-985b1b6f-6abe-400e-9bd2-e477a72a815c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:03.913033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] The token cache is being invalidate because project 7c8ea9b11c4644bf9aa9e06f8a363119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:03.913352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:03.914033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-985b1b6f-6abe-400e-9bd2-e477a72a815c tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:03.915619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 890/1781] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:03 2022] DELETE /identity/v3/projects/7c8ea9b11c4644bf9aa9e06f8a363119 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:04.518822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:04.520537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:04.589980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5488748-0671-4a46-96d2-a61d1a2d8f45 tempest-VolumeQuotaClassesTest-1033288351 tempest-VolumeQuotaClassesTest-1033288351-project-admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:04.658046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:04.658932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:04.659222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:04.659494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] PATH_INFO: `/v3/users/5437f4a9474d461b91c91dafc2be5202` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:04.660858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5437f4a9474d461b91c91dafc2be5202)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:04.662835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:04.899407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5437f4a9474d461b91c91dafc2be5202'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:04.900144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5437f4a9474d461b91c91dafc2be5202'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:04.907799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5437f4a9474d461b91c91dafc2be5202'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:04.967845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5437f4a9474d461b91c91dafc2be5202'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:04.972133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5437f4a9474d461b91c91dafc2be5202'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.001210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 892/1782] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:04 2022] DELETE /identity/v3/users/5437f4a9474d461b91c91dafc2be5202 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:05.005481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096166-95b4-43c9-9bab-7bdace8dde96 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.006322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096166-95b4-43c9-9bab-7bdace8dde96 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.006741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e096166-95b4-43c9-9bab-7bdace8dde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.025467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3e096166-95b4-43c9-9bab-7bdace8dde96 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:05.027630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3e096166-95b4-43c9-9bab-7bdace8dde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:05.092692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 891/1783] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:05.102480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:05.103889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:05.161583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623e863-d73e-47e6-a27e-d2120c3ae091 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:05.165383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:05.166040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.166328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.166605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.176092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:05.177613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798d3cc-87d5-43bf-a7e9-f315d12748ef service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:05.187788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 893/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:05.216777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.217197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.217546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.219459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 892/1785] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 12:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 12:59:05.229122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.229787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.230470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.250492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:05.251713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:05.321959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 894/1786] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:05.353384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:05.355239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:05.374218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2ac1-b730-4cc0-8ca2-643d1508b074 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:05.380087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:05.380760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.381062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.381341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.391838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:05.393874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:05.404769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 893/1787] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:05.643983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:05.645571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:05.660536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0a648-61e6-4072-8625-f41641350c3f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:05.668905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:05.668905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.668905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.668905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] PATH_INFO: `/v3/projects/197c59b0e8de43309694b7dd5c9e5253` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.669296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197c59b0e8de43309694b7dd5c9e5253)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:05.669938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:05.763801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197c59b0e8de43309694b7dd5c9e5253', 'request_id': 'req-e39df268-2262-4f11-9766-23f8bc6d0f60'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.769270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197c59b0e8de43309694b7dd5c9e5253', 'request_id': 'req-e39df268-2262-4f11-9766-23f8bc6d0f60'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.857544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197c59b0e8de43309694b7dd5c9e5253', 'request_id': 'req-e39df268-2262-4f11-9766-23f8bc6d0f60'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.871315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] The token cache is being invalidate because project 197c59b0e8de43309694b7dd5c9e5253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:05.871531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.872218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:05.874010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 895/1788] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:05 2022] DELETE /identity/v3/projects/197c59b0e8de43309694b7dd5c9e5253 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:05.877744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:05.888965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2aac-213b-4984-9871-245bcf2a00a9 service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:05.943796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:05.944678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:05.944965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:05.945283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] PATH_INFO: `/v3/users/eb4d33195aaf416583b7be2f3a2aead7` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:05.946471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4d33195aaf416583b7be2f3a2aead7)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:05.949016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:06.121745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4d33195aaf416583b7be2f3a2aead7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.128623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4d33195aaf416583b7be2f3a2aead7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.129418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4d33195aaf416583b7be2f3a2aead7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.216603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4d33195aaf416583b7be2f3a2aead7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.217301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b314e4-d274-4014-8a8e-8c0684de865c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4d33195aaf416583b7be2f3a2aead7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.237706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 894/1789] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:05 2022] DELETE /identity/v3/users/eb4d33195aaf416583b7be2f3a2aead7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:06.663950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:06.665744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:06.679510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39df268-2262-4f11-9766-23f8bc6d0f60 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:06.746776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:06.747667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:06.747952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:06.748567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] PATH_INFO: `/v3/projects/b069a7a2f7d84b11a61a14ecc643a531` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:06.749870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b069a7a2f7d84b11a61a14ecc643a531)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:06.751781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:06.881924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b069a7a2f7d84b11a61a14ecc643a531', 'request_id': 'req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.887480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b069a7a2f7d84b11a61a14ecc643a531', 'request_id': 'req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.953777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b069a7a2f7d84b11a61a14ecc643a531', 'request_id': 'req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.970188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] The token cache is being invalidate because project b069a7a2f7d84b11a61a14ecc643a531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:06.970666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.971471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e3c28dbe-74fe-4cf7-ac8b-abf4caea10d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:06.973270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 896/1790] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:06 2022] DELETE /identity/v3/projects/b069a7a2f7d84b11a61a14ecc643a531 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:06.979375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:06.980532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:06.981156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.002187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:07.003867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:07.076620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 895/1791] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:07.084295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.084587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.084867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.110476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:07.110476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:07.116549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 897/1792] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:07.121390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.131527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675ac6-1bfa-4d42-bff1-4588ff69b575 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.136972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.137946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.138330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.138614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.139431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:07.139655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.141390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.153855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 896/1793] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:07.158307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.168168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ddab6-a173-47b2-ac88-67eb0c07c240 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.172762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.173447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.173731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.174005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.174696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.176587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.269624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 898/1794] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:07 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:07.273794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.284262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af5d5-f54d-4333-bf12-ebdcaba204a9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.341350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.342026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.342308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.342582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.343278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.345222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.423275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 897/1795] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:07 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:07.427196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.437958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550ea48-d112-4034-b828-587e2fcc445f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.442716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.443403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.443798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.444110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.444969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.446616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.457578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 899/1796] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:07.461503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.472022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914aeb3-21e9-440e-9726-80af9fb200b7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.476558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.477538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.477828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.478100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.478820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.481157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad0ec2-a416-4810-81b6-44347ac482ae admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.490771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 898/1797] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:07.494642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.504148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3453b-d3f7-4a2c-bc48-3b3b9d9be1d1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.508634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.509551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.509842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.510115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] PATH_INFO: `/v3/projects/1ed0b3f32d924e01b9daef7bd7fb2c3d/users/f53b071bbc1348bfa201064b4cc69f09/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.525438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed0b3f32d924e01b9daef7bd7fb2c3d, user_id=f53b071bbc1348bfa201064b4cc69f09, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.528726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.607523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 900/1798] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:07 2022] PUT /identity/v3/projects/1ed0b3f32d924e01b9daef7bd7fb2c3d/users/f53b071bbc1348bfa201064b4cc69f09/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:07.623012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.623329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.623616 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.650034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] MFA Rules not processed for user `f53b071bbc1348bfa201064b4cc69f09`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:07.651235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:07.713204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 899/1799] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:07.724287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:07.726041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:07.781320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcddbd-e469-4c7e-aa94-64b4ec3a8b21 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:07.784857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:07.785532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:07.785823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:07.786104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:07.794918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:07.796352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fdac6-4a48-437c-bb0b-0aae5cbeeb9d service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:07.804936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 901/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:08.654938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:08.657207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:08.766865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24172c-9751-49d1-929f-033716f0dd52 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:08.790097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:08.790097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:08.790097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:08.790097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] PATH_INFO: `/v3/users/8cb596917a57452f9e06d51f2bcecd25` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:08.790417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb596917a57452f9e06d51f2bcecd25)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:08.790417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:09.005283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb596917a57452f9e06d51f2bcecd25'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:09.015979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb596917a57452f9e06d51f2bcecd25'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:09.017267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb596917a57452f9e06d51f2bcecd25'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:09.133849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb596917a57452f9e06d51f2bcecd25'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:09.136278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb596917a57452f9e06d51f2bcecd25'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:09.177157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 900/1801] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:08 2022] DELETE /identity/v3/users/8cb596917a57452f9e06d51f2bcecd25 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:09.178918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:09.179364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:09.179489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:09.199686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:09.201517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:09.309905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 902/1802] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:09.319611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:09.321124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:09.392881 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44863997-204f-40b3-881a-9cc2cc168cf5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:09.396912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:09.397522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:09.398069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:09.398069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:09.410401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:09.411921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:09.423520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 901/1803] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:09.981871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:09.983457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:09.999670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a01ac8-8f6d-4df3-a37b-33c6e7bd283c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:10.005437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:10.006304 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:10.006586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:10.006877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] PATH_INFO: `/v3/projects/e1675a05d38a49b08e9b59a89af3e859` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:10.008084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1675a05d38a49b08e9b59a89af3e859)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:10.011223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:10.148603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1675a05d38a49b08e9b59a89af3e859', 'request_id': 'req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.156958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1675a05d38a49b08e9b59a89af3e859', 'request_id': 'req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.264952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1675a05d38a49b08e9b59a89af3e859', 'request_id': 'req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.277832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] The token cache is being invalidate because project e1675a05d38a49b08e9b59a89af3e859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:10.278195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.278906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.280587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 903/1804] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:09 2022] DELETE /identity/v3/projects/e1675a05d38a49b08e9b59a89af3e859 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:10.284441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:10.294923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc0c-49dd-47a6-ae39-21d756763e36 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:10.371076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:10.372312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:10.372797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:10.373319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] PATH_INFO: `/v3/users/8a498719ac7641b2a2f19e6e935df191` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:10.379116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a498719ac7641b2a2f19e6e935df191)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:10.382396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:10.634235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a498719ac7641b2a2f19e6e935df191'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.649204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a498719ac7641b2a2f19e6e935df191'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.649204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a498719ac7641b2a2f19e6e935df191'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.736592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a498719ac7641b2a2f19e6e935df191'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.741322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1b1d6bf6-0895-4486-b3ab-e84ec4a1abf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a498719ac7641b2a2f19e6e935df191'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:10.794623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 902/1805] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:10 2022] DELETE /identity/v3/users/8a498719ac7641b2a2f19e6e935df191 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:11.282027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:11.283644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:11.302377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6ae9-db0b-4ae0-a7f5-93cc73be904a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:11.373001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:11.373818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:11.374105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:11.374380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] PATH_INFO: `/v3/projects/b143e102b02b4f55bb958d99818db5a4` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:11.375600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b143e102b02b4f55bb958d99818db5a4)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:11.377546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:11.503210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b143e102b02b4f55bb958d99818db5a4', 'request_id': 'req-8dd392b2-38a6-4b01-8a99-dd82595a2c36'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:11.509499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b143e102b02b4f55bb958d99818db5a4', 'request_id': 'req-8dd392b2-38a6-4b01-8a99-dd82595a2c36'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:11.621609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b143e102b02b4f55bb958d99818db5a4', 'request_id': 'req-8dd392b2-38a6-4b01-8a99-dd82595a2c36'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:11.633927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] The token cache is being invalidate because project b143e102b02b4f55bb958d99818db5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:11.634142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:11.635076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8dd392b2-38a6-4b01-8a99-dd82595a2c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:11.637817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 904/1806] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:11 2022] DELETE /identity/v3/projects/b143e102b02b4f55bb958d99818db5a4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:11.642872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:11.643371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:11.643611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:11.662024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:11.663391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:11.724187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 903/1807] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:11.732205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:11.732501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:11.732781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:11.757602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:11.758849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:11.767884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 905/1808] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:11.772246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:11.782389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bf647-1b19-4d25-8f2d-0a1a40326a9d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:11.786997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:11.787673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:11.787958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:11.788233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:11.788963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:11.789301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:11.790912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:11.803780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 904/1809] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:11.808102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:11.817343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174c6e1-d836-4750-8a1d-7aa92adc7292 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:11.822046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:11.822761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:11.823230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:11.823657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:11.824353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:11.826375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:11.976626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 906/1810] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:11.980608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:11.996164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9122587-0166-4e92-8434-bce129afd1ee admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.055483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.056605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.057063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.058180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.059666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.061266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.158159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 905/1811] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:11 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:12.163585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.183038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedf5e-0f1f-4cdf-bf9b-c4e6a37014ba admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.196054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.196789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.197158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.197343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.198217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.200224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.221592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 907/1812] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:12.229865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.234807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8a7e7-1743-4f94-a86e-09044216ae8d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.242278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.245116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.246324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.247089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.247834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.250528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53a974-2b07-40a8-af01-89be3b59f5a8 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.269073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 906/1813] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:12.270727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.281786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1e6ac-19ac-45db-b716-db841c5930ee admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.286378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.287269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.292652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.292652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] PATH_INFO: `/v3/projects/57e94e28de974d12a5483b460b95eb6d/users/e370ae7a57e645019abb455f4d8f9c9a/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.303029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e94e28de974d12a5483b460b95eb6d, user_id=e370ae7a57e645019abb455f4d8f9c9a, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.305900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.411294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 908/1814] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:12 2022] PUT /identity/v3/projects/57e94e28de974d12a5483b460b95eb6d/users/e370ae7a57e645019abb455f4d8f9c9a/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:12.425861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.426393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.426887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.459996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] MFA Rules not processed for user `e370ae7a57e645019abb455f4d8f9c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:12.461240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:12.500010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.502050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:12.547295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 907/1815] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:12.548406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.594741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022f453-5d03-42d3-b237-c9e665cbd41a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.595927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.598201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.598584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.598959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] PATH_INFO: `/v3/users/f53b071bbc1348bfa201064b4cc69f09` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.600537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53b071bbc1348bfa201064b4cc69f09)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.602988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.616845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc677a-0f26-4a55-9d66-947b8780cadf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.622575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.623251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.623541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.624117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.624821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.626907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.735478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 908/1816] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:12 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:12.739269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.802314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8075f1-551a-48fa-8afe-bcca2f615da2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.807937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.808654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.809068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.809347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.810037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.812056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.812627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53b071bbc1348bfa201064b4cc69f09'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:12.813487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53b071bbc1348bfa201064b4cc69f09'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:12.821195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53b071bbc1348bfa201064b4cc69f09'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:12.908114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 909/1817] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:12 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:12.909156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.919764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfe2e0-5860-47d7-aba7-1d8f30c81f65 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.924779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:12.924939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53b071bbc1348bfa201064b4cc69f09'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:12.925475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.925757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.926370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3f0cdb86-3117-40da-b81e-c2aa46adc66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53b071bbc1348bfa201064b4cc69f09'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:12.926826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.927605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:12.929242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:12.944657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 910/1818] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:12.946004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:12.947847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:12.949199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 909/1819] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:12 2022] DELETE /identity/v3/users/f53b071bbc1348bfa201064b4cc69f09 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:12.953539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:12.953920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:12.954393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:12.963976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19260321-eb4d-4129-b85a-20fb57efbb45 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:12.973263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:12.974598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.027148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.028064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.028351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.028633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] PATH_INFO: `/v3/projects/9cbb05690a9447e99958514ccb4834c8/users/091aa1c9b9de46859fc718329889eb4f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.048191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbb05690a9447e99958514ccb4834c8, user_id=091aa1c9b9de46859fc718329889eb4f, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.051359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.056256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 910/1820] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:13.066063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.067465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.147857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd478aca-d0fb-47ac-8a45-fabafdeecb90 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.153566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 911/1821] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:12 2022] PUT /identity/v3/projects/9cbb05690a9447e99958514ccb4834c8/users/091aa1c9b9de46859fc718329889eb4f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:13.157693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.230971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.231875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.232536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.232702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.286745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ff2f6-f9f4-4e59-94ab-5e68d00010ff admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.297882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.298582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.298870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.299144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.299977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.301799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.308475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.310616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c9da6-6f95-4438-823e-682f34063b22 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.318238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 912/1822] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:13.322149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 911/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:13.323977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.338291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a129-fd56-49b7-b92a-4e1521c781f7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.344279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.345318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.345808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.346657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] PATH_INFO: `/v3/projects/9cbb05690a9447e99958514ccb4834c8/users/091aa1c9b9de46859fc718329889eb4f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.349387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cbb05690a9447e99958514ccb4834c8, user_id=091aa1c9b9de46859fc718329889eb4f, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.355171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.372829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 913/1824] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:13 2022] PUT /identity/v3/projects/9cbb05690a9447e99958514ccb4834c8/users/091aa1c9b9de46859fc718329889eb4f/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:13.383202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.383504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.383789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.418777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] MFA Rules not processed for user `091aa1c9b9de46859fc718329889eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:13.420119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.518147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 912/1825] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:13.530206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.531926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.615028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.616544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.695588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5f23c-5af6-4bd4-9ce2-593cabe5644a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.701959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.702903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.703154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.703433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] PATH_INFO: `/v3/users/3e86812480564167b70dafa7c5ddec8e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.704657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e86812480564167b70dafa7c5ddec8e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.707660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.738980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96009b56-8bb5-421c-b90b-574a521ef669 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.743180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.743832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.744116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.744393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.756010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.757628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.768704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 914/1826] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:13.834810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:13.839102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:13.855265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda2014-b69a-4b31-aef4-3a4e10a151c6 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:13.859986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:13.860848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:13.861243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:13.861524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] PATH_INFO: `/v3/projects/1ed0b3f32d924e01b9daef7bd7fb2c3d` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:13.863855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed0b3f32d924e01b9daef7bd7fb2c3d)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:13.865816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:13.926011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e86812480564167b70dafa7c5ddec8e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:13.926780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e86812480564167b70dafa7c5ddec8e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:13.934053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e86812480564167b70dafa7c5ddec8e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.051849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed0b3f32d924e01b9daef7bd7fb2c3d', 'request_id': 'req-594c87b0-09ae-41e9-8800-f661a451500f'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.057713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed0b3f32d924e01b9daef7bd7fb2c3d', 'request_id': 'req-594c87b0-09ae-41e9-8800-f661a451500f'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.085387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e86812480564167b70dafa7c5ddec8e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.086017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e86812480564167b70dafa7c5ddec8e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.108745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 913/1827] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:13 2022] DELETE /identity/v3/users/3e86812480564167b70dafa7c5ddec8e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:14.123556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:14.125142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.195754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110149c8-e37d-41f2-8d69-0ba8b6c0226e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:14.201506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:14.202570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.202861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.203140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] PATH_INFO: `/v3/users/e370ae7a57e645019abb455f4d8f9c9a` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.204585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e370ae7a57e645019abb455f4d8f9c9a)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:14.206559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:14.224781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed0b3f32d924e01b9daef7bd7fb2c3d', 'request_id': 'req-594c87b0-09ae-41e9-8800-f661a451500f'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.268098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] The token cache is being invalidate because project 1ed0b3f32d924e01b9daef7bd7fb2c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:14.269399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.272085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-594c87b0-09ae-41e9-8800-f661a451500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.274828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 915/1828] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:13 2022] DELETE /identity/v3/projects/1ed0b3f32d924e01b9daef7bd7fb2c3d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:14.277081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9240-6808-4b1b-a1c6-c7f88f2a0899 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.292794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9240-6808-4b1b-a1c6-c7f88f2a0899 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.293160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9240-6808-4b1b-a1c6-c7f88f2a0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.326163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a46a9240-6808-4b1b-a1c6-c7f88f2a0899 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:14.328403 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a46a9240-6808-4b1b-a1c6-c7f88f2a0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.368056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 916/1829] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:14.370525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.385602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.388992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.439138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:14.444823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.448546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e370ae7a57e645019abb455f4d8f9c9a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.450894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e370ae7a57e645019abb455f4d8f9c9a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.467903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 917/1830] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:14.467903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:14.479901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.480283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e370ae7a57e645019abb455f4d8f9c9a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.584020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39864d-7ef8-425e-a521-96d60ad7dfa5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:14.590266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:14.590836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e370ae7a57e645019abb455f4d8f9c9a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.591236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.591510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db18f63d-6cef-424a-899d-c898675f3d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e370ae7a57e645019abb455f4d8f9c9a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:14.591668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.592004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.594235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.637138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:14.641056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3bade-2429-4f6d-b1b1-feea504d51db service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:14.673828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 914/1831] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:14 2022] DELETE /identity/v3/users/e370ae7a57e645019abb455f4d8f9c9a => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:14.676071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.676643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.677216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.686466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 918/1832] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:14.692720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.692720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.692720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.721148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:14.725206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.769158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:14.769158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.850712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 915/1833] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:14.856797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:14.865892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 919/1834] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:14.866074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ca22-6a43-4644-a5a0-72ec40199b40 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:14.872205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:14.872889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.873273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.873551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.874285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:14.874594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:14.876281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:14.876486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:14.879517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:14.893846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 916/1835] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:14.894436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:14.910030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e96e-1736-401a-9aab-102426dadb12 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:14.923913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:14.925200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.925506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.925790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:14.926498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:14.928421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:14.984061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2caa40-d9f2-4921-8262-90cc6b6a2e88 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:14.987975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:14.988633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:14.988917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:14.989221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.000270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.001756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.012414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 920/1836] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:15.201632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 917/1837] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:15.203149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.214293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63ead-7eab-41cc-8eb9-fd3df910c570 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.277228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.284300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.284300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.284300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.284300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.284300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.368652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 921/1838] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:15 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:15.376465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.386340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893590c-b9da-458d-9387-ca4e434dc8ed admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.391297 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.391960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.392378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.392639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.393414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.395277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.406292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 918/1839] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:15.411845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.421800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59c1ba-66e7-495a-bd26-fd2fe0075897 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.426770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.427436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.427716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.427989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.428704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.434096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84d8e0-0eea-451c-bf85-48661e8b8ad5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.444659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 922/1840] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:15.449109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.459606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd005e7-a6aa-4f46-b1c0-43b42d84f218 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.465731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.467204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.467592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.467968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] PATH_INFO: `/v3/projects/22339cbeb73742a6bc63c3f7e355b0e8/users/285ea9b351af4937a24028c09a4477c8/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.484457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22339cbeb73742a6bc63c3f7e355b0e8, user_id=285ea9b351af4937a24028c09a4477c8, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.487306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.599978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 919/1841] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:15 2022] PUT /identity/v3/projects/22339cbeb73742a6bc63c3f7e355b0e8/users/285ea9b351af4937a24028c09a4477c8/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:15.607807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.608102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.608378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.638006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] MFA Rules not processed for user `285ea9b351af4937a24028c09a4477c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:15.639237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:15.658748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.660706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:15.747877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 923/1842] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:15.749015 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:15.750414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:15.784657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c692e1-ec8d-4e2f-92c6-b6ca3db10199 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.789875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.790742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.791211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.792289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] PATH_INFO: `/v3/projects/e777450b62424d60a44d07177c5d5c02` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.793943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e777450b62424d60a44d07177c5d5c02)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.795863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.840799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985239b-4e24-4737-95fc-4ec3b50f5a8b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:15.854859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:15.854859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:15.854859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:15.854859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] PATH_INFO: `/v3/projects/57e94e28de974d12a5483b460b95eb6d` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:15.855598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e94e28de974d12a5483b460b95eb6d)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:15.855598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:15.966180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e777450b62424d60a44d07177c5d5c02', 'request_id': 'req-4823e38b-e1e5-47ec-8553-41d1356fa850'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:15.972994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e777450b62424d60a44d07177c5d5c02', 'request_id': 'req-4823e38b-e1e5-47ec-8553-41d1356fa850'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.017574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e94e28de974d12a5483b460b95eb6d', 'request_id': 'req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.023870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e94e28de974d12a5483b460b95eb6d', 'request_id': 'req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.085100 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e777450b62424d60a44d07177c5d5c02', 'request_id': 'req-4823e38b-e1e5-47ec-8553-41d1356fa850'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.099311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] The token cache is being invalidate because project e777450b62424d60a44d07177c5d5c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:16.099606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.100451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.102080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 920/1843] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:15 2022] DELETE /identity/v3/projects/e777450b62424d60a44d07177c5d5c02 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:16.102987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.106829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:16.187293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823e38b-e1e5-47ec-8553-41d1356fa850 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.201805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e94e28de974d12a5483b460b95eb6d', 'request_id': 'req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.218644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] The token cache is being invalidate because project 57e94e28de974d12a5483b460b95eb6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:16.218933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.219602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.221451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 924/1844] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:15 2022] DELETE /identity/v3/projects/57e94e28de974d12a5483b460b95eb6d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:16.225020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.227877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:16.245953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.246622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.246908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.247181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.247873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:16.254900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:16.303583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db46d6-5af4-4e07-aa68-c6cbfe0c7312 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.310199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.311465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.312080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.312190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] PATH_INFO: `/v3/users/cc233608a2394d8f8643116f2a274ada` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.313550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc233608a2394d8f8643116f2a274ada)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:16.316974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:16.356298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 921/1845] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:16 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:16.356970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.358998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:16.425934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ea3e4-601e-48f5-967a-0ad0fb2a5f2c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.430867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.431739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.432024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.432328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] PATH_INFO: `/v3/users/091aa1c9b9de46859fc718329889eb4f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.433766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091aa1c9b9de46859fc718329889eb4f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:16.435619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:16.555682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc233608a2394d8f8643116f2a274ada'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.574271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc233608a2394d8f8643116f2a274ada'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.581541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc233608a2394d8f8643116f2a274ada'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.636731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091aa1c9b9de46859fc718329889eb4f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.637757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091aa1c9b9de46859fc718329889eb4f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.645760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091aa1c9b9de46859fc718329889eb4f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.675926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc233608a2394d8f8643116f2a274ada'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.676549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc233608a2394d8f8643116f2a274ada'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.695217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 925/1846] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:16 2022] DELETE /identity/v3/users/cc233608a2394d8f8643116f2a274ada => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:16.706548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.708380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:16.779263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091aa1c9b9de46859fc718329889eb4f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.780412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091aa1c9b9de46859fc718329889eb4f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:16.793335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce409-a604-43e6-aa6e-3367f6d28c6f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.798472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.799532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.800094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.800473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.801301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:16.803717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:16.806002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 922/1847] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:16 2022] DELETE /identity/v3/users/091aa1c9b9de46859fc718329889eb4f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:16.882147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 926/1848] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:16 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:16.887468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.888749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:16.954045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838713-174e-4056-9674-f27290fc9411 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.959149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.959825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.960112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.960396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.961193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:16.962821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:16.974257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 923/1849] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:16.979756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:16.991278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9e92-33ff-4763-b53e-2dd436221508 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:16.997212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:16.997964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:16.998255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:16.998591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:16.999655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.001917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6828-581b-4940-bba6-36955fd2ca8d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.024823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 927/1850] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:17.029357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:17.040458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe01be2-4d80-4dd4-8377-c72ecd0b3bc6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:17.046523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:17.047412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.047699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.048046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] PATH_INFO: `/v3/projects/e75dd4dd799143d0b4cdda89f01a44a7/users/18707b33985442afbf717fb6d6ca3a93/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.065438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75dd4dd799143d0b4cdda89f01a44a7, user_id=18707b33985442afbf717fb6d6ca3a93, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.067270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.159341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 924/1851] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:17 2022] PUT /identity/v3/projects/e75dd4dd799143d0b4cdda89f01a44a7/users/18707b33985442afbf717fb6d6ca3a93/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:17.171140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.171435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.171709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.198724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] MFA Rules not processed for user `18707b33985442afbf717fb6d6ca3a93`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:17.199918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.270348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 928/1852] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:17.274793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:17.328868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:17.330034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.356611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc1aed-3369-4b70-bde8-21611f825a5f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:17.362893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:17.363572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.363864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.364149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.364864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.366869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.421316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b31d1-227a-4b39-84d1-c4b05e09aea7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:17.425197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:17.426085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.426357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.426633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] PATH_INFO: `/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.427820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b8669292eb4558a8d1a63f6ce80ea0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.429934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.451595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 925/1853] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:17.453214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:17.457290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.527549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec930d-7025-407e-ba47-ee02a068c203 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:17.537464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:17.538354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.538640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.538916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] PATH_INFO: `/v3/projects/9cbb05690a9447e99958514ccb4834c8` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.540202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cbb05690a9447e99958514ccb4834c8)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.542215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.582369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b8669292eb4558a8d1a63f6ce80ea0', 'request_id': 'req-1e319dfe-d373-44ed-91af-66135a96d0d2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.587963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b8669292eb4558a8d1a63f6ce80ea0', 'request_id': 'req-1e319dfe-d373-44ed-91af-66135a96d0d2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.672101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cbb05690a9447e99958514ccb4834c8', 'request_id': 'req-f952b892-adeb-4c62-b1ac-71b387a6d529'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.678257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cbb05690a9447e99958514ccb4834c8', 'request_id': 'req-f952b892-adeb-4c62-b1ac-71b387a6d529'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.684799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b8669292eb4558a8d1a63f6ce80ea0', 'request_id': 'req-1e319dfe-d373-44ed-91af-66135a96d0d2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.706571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] The token cache is being invalidate because project 98b8669292eb4558a8d1a63f6ce80ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:17.706869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.708262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.710792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 929/1854] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:17 2022] DELETE /identity/v3/projects/98b8669292eb4558a8d1a63f6ce80ea0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:17.717270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:17.722254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.767456 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cbb05690a9447e99958514ccb4834c8', 'request_id': 'req-f952b892-adeb-4c62-b1ac-71b387a6d529'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.781217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] The token cache is being invalidate because project 9cbb05690a9447e99958514ccb4834c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:17.781669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.782675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f952b892-adeb-4c62-b1ac-71b387a6d529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:17.788698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 926/1855] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:17 2022] DELETE /identity/v3/projects/9cbb05690a9447e99958514ccb4834c8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:17.790354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8e51d-5df3-465d-827e-80e2cb0b3261 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.790743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8e51d-5df3-465d-827e-80e2cb0b3261 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.791207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8e51d-5df3-465d-827e-80e2cb0b3261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.816437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ddd8e51d-5df3-465d-827e-80e2cb0b3261 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:17.818002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ddd8e51d-5df3-465d-827e-80e2cb0b3261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.818615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319dfe-d373-44ed-91af-66135a96d0d2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:17.913531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 927/1856] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:17.915040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830ee6-5191-4a49-9ddf-76752481ee9e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.915396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830ee6-5191-4a49-9ddf-76752481ee9e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.915777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81830ee6-5191-4a49-9ddf-76752481ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.922293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:17.923076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.923504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.924081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.924879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:17.928019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:17.944756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-81830ee6-5191-4a49-9ddf-76752481ee9e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:17.946352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-81830ee6-5191-4a49-9ddf-76752481ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:17.961209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 928/1857] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:17.966963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cddb-5f14-436f-a620-99a6ce65177c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:17.966963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cddb-5f14-436f-a620-99a6ce65177c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:17.966963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cddb-5f14-436f-a620-99a6ce65177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:17.987597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4049cddb-5f14-436f-a620-99a6ce65177c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:17.989864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4049cddb-5f14-436f-a620-99a6ce65177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:18.002985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 929/1858] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:18.002985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.002985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.002985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.018006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 930/1859] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/users => generated 295 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:18.018006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.021231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:18.022480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:18.029351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0b87b-110e-4922-9f9c-14365138162b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.035896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 930/1860] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:18.035896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.042297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.042297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.042647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:18.042802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.042802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.042802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:18.042802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.042802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.048226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef7be-2ad9-443b-b034-55aaaca971d2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.053604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.054362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.054704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.055066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.055772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 931/1861] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:18.056702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.061268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.062943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.069195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58358463-04dd-4b38-a352-6c852b492fdf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.074681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 931/1862] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:18.074845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.075760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.075882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.076268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.076642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.077513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:18.077920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.079768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.092537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 932/1863] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:18.093357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d089a6b-b6ce-4b8c-8ba3-2e06c922d63b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.093694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.100871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.102223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.102684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.103356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.104761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.106870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.122660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ab205-2f7b-40ba-83c7-0d90c65c1183 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.138172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.138738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.139023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.139804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] PATH_INFO: `/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8/users/9e5a376bc97b4699bc43dbe360181150/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.156069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0d2a35eea94041bc78270b8c7c89f8, user_id=9e5a376bc97b4699bc43dbe360181150, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.158960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.224521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 932/1864] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:18 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:18.224521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.267008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 933/1865] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:18 2022] PUT /identity/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8/users/9e5a376bc97b4699bc43dbe360181150/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:18.267973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.351204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb12f32-0ba8-4b01-bbb7-a1bef4d988cc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.415752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3beec-55ca-4dcc-a693-73923169298c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.428428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.429186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.434908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.434908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.434908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.442515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.499553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.500226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.500496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.500772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.501515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.504338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.618003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 934/1866] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:18 2022] POST /identity/v3/users => generated 285 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:18.618003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.626790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7299da-ac9d-4859-a34f-a99cb31ad98e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.631843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.635111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.635111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.636041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.637152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.639019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.644235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 933/1867] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:18 2022] POST /identity/v3/projects => generated 359 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:18.649377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.656429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 935/1868] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:18.656429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.667109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbec3-40d1-427b-b796-1f83e2ab1cbe admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.725917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.726591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.726875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.727150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.727838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.730043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea4b87-1266-499f-b400-f6092bf50727 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.734580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c669c-bb82-4cd7-b13a-61e3b1e0abb2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.740424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.741141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.741418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.741695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.742427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.744128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.755268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 934/1869] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:18.756057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.766679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71d5d-e11b-4b88-8d07-b516dd84c1b3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.771354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.772225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.772512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.772791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] PATH_INFO: `/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8/users/9e5a376bc97b4699bc43dbe360181150/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.774795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0d2a35eea94041bc78270b8c7c89f8, user_id=9e5a376bc97b4699bc43dbe360181150, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.778293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.789137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 935/1870] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:18 2022] PUT /identity/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8/users/9e5a376bc97b4699bc43dbe360181150/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:18.789963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.811695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 936/1871] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:18 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:18.813389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.813742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.814104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.843825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] MFA Rules not processed for user `9e5a376bc97b4699bc43dbe360181150`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:18.844895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:18.867221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02b04d-9e5a-48fc-a755-63c2b825df18 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.872664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.873491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.873780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.874059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.874785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.876392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.891261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 936/1872] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:18.892108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.905570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c77c24-cbb5-4ff4-8a04-5a9bc29637f9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.910248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.910925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.911373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.911655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.912386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.914060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:18.919813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 937/1873] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:18.920876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.933865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 937/1874] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:18.934834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:18.936478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:18.937797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822fa5a-4ca7-45f7-883e-7597068e7ef6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:18.942518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:18.943424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:18.943705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:18.943979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] PATH_INFO: `/v3/projects/80acb009468447649befeae03b6435bc/users/d9aa87fa65804206bd9f9f2d595c1715/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:18.960639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80acb009468447649befeae03b6435bc, user_id=d9aa87fa65804206bd9f9f2d595c1715, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:18.964066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.002705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a651-dc97-4299-a58f-5e153c1ba581 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.006496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.007168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.008692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.008692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.009951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:19.035332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 938/1875] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:18 2022] PUT /identity/v3/projects/80acb009468447649befeae03b6435bc/users/d9aa87fa65804206bd9f9f2d595c1715/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:19.036739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.076322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.078347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658f77c-ac3c-4ced-9088-c9588dbd6d3d service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.089789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 938/1876] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:19.090997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.091371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.091708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.112525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d7b2c-d30f-4b0e-8e83-b3fb14535044 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.117617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.118379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.118923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.119051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.120555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.122452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] MFA Rules not processed for user `d9aa87fa65804206bd9f9f2d595c1715`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:19.122601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.123839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:19.139670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 939/1877] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:19.140579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.151366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b93043-0ff9-4eca-8486-1e7de5a5a815 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.156693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.157901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.158290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.158669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] PATH_INFO: `/v3/projects/be42d3a241724cec84d51e5f359bd7c3/users/aaae9b3197f94951a37da963d4206780/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.175034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be42d3a241724cec84d51e5f359bd7c3, user_id=aaae9b3197f94951a37da963d4206780, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.178554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab83f9-1a4a-43ca-aa7f-089d16db431f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.208047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 939/1878] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:19.212767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.227568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fbbde-c0da-4566-a86e-3ed6c1b8ecc5 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.234098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.234869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.235189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.235974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.236688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.239581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.263203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 940/1879] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:19 2022] PUT /identity/v3/projects/be42d3a241724cec84d51e5f359bd7c3/users/aaae9b3197f94951a37da963d4206780/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:19.274615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.275028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.275366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.305670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] MFA Rules not processed for user `aaae9b3197f94951a37da963d4206780`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:19.307573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:19.361148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 940/1880] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:19 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:19.364635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.383541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 941/1881] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:19.423362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.425080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:19.443150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772475e-319a-4f45-a2ef-6fc81cf92fa3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.449051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.449756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.450124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.450315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.451036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.453365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.497937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9996a-0d0c-412a-aaa7-57fcdacd503f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.556711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 941/1882] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:19 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:19.561020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.582718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e4bb1-8abb-4ef0-915c-5c9daef57250 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.589773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.590591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.590977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.591353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.597604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.598420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.599009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.599443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.601022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.602900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.627597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 942/1883] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:19.632161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.649353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491c2b-73c4-4231-b140-da3919edea88 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.655963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.657025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.657680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.657907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] PATH_INFO: `/v3/projects/58e470e514b84fac97cca0820316abe4/users/26effd9db2d248028d4893b4f51a60f3/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.676504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e470e514b84fac97cca0820316abe4, user_id=26effd9db2d248028d4893b4f51a60f3, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.681184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.694140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.695837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.728630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 942/1884] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:19 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:19.749665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.765364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218597d-401b-4787-ba43-67b3ace3d01e service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.772387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:19.773969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:19.774477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:19.774899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] PATH_INFO: `/v3/users/aaae9b3197f94951a37da963d4206780` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:19.777144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaae9b3197f94951a37da963d4206780)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:19.781461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:19.820447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 943/1885] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:19 2022] PUT /identity/v3/projects/58e470e514b84fac97cca0820316abe4/users/26effd9db2d248028d4893b4f51a60f3/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:19.839103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:19.987399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13f430-9741-4e72-9770-396741a6c611 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:19.988983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaae9b3197f94951a37da963d4206780'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:20.002277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:20.003246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.003649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.003958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.004405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaae9b3197f94951a37da963d4206780'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:20.005092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:20.005568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaae9b3197f94951a37da963d4206780'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:20.007870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:20.031587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 944/1886] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:20.032428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:20.048890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62375baf-4f78-4213-ac17-d98d7fedeab5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:20.054282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:20.055184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.058964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.058964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] PATH_INFO: `/v3/projects/58e470e514b84fac97cca0820316abe4/users/26effd9db2d248028d4893b4f51a60f3/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.058964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e470e514b84fac97cca0820316abe4, user_id=26effd9db2d248028d4893b4f51a60f3, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:20.061210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae075a9b-0396-4554-81e4-fee0e25e7be7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:20.073320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 945/1887] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:20 2022] PUT /identity/v3/projects/58e470e514b84fac97cca0820316abe4/users/26effd9db2d248028d4893b4f51a60f3/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:20.083897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.084595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.084957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.110191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaae9b3197f94951a37da963d4206780'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:20.111039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-67490a5f-9c7d-4066-9bc6-dae45b3373f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaae9b3197f94951a37da963d4206780'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:20.117652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] MFA Rules not processed for user `26effd9db2d248028d4893b4f51a60f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:20.119183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:20.141740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 943/1888] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:19 2022] DELETE /identity/v3/users/aaae9b3197f94951a37da963d4206780 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:20.146969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.147385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.147899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.182378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:20.184688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:20.217931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 946/1889] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:20.242145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:20.243591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:20.269498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 944/1890] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:20.280911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:20.282984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:20.328319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52579089-9aa4-4243-8806-8ff7991b385f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:20.362857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ab2c5-7e0b-4d90-af0a-0354ddd11d83 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:20.370604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:20.371263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.371543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.371820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.387275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:20.387920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:20.388697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:20.389072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:20.389452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:20.389828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:20.404086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 945/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:20.461479 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:20.463816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd865c-819c-4bfa-a8e5-a6f0ce05168d service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:20.477798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 947/1892] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:21.078384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:21.079834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:21.092706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef4ccd-301f-4e80-b452-c14ebf92da9c service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:21.097242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:21.098095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.098375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.098642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] PATH_INFO: `/v3/projects/be42d3a241724cec84d51e5f359bd7c3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.099823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be42d3a241724cec84d51e5f359bd7c3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:21.101740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:21.226824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be42d3a241724cec84d51e5f359bd7c3', 'request_id': 'req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:21.233259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be42d3a241724cec84d51e5f359bd7c3', 'request_id': 'req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:21.330445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be42d3a241724cec84d51e5f359bd7c3', 'request_id': 'req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:21.342554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] The token cache is being invalidate because project be42d3a241724cec84d51e5f359bd7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:21.342849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:21.343524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d90afd11-9cc8-4c98-8fd6-edb7176f38b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:21.345123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 946/1893] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:21 2022] DELETE /identity/v3/projects/be42d3a241724cec84d51e5f359bd7c3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:21.350030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.350516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.350596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.389696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:21.397808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:21.471179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 948/1894] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:21.478999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.479445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.479676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.498518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:21.499663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:21.508212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 947/1895] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:21.518642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:21.524211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29068b-349a-4797-8319-b34bff44ccb0 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:21.529718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:21.530498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.530891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.531279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.532115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:21.532541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:21.534482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:21.551338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 949/1896] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:21.556073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:21.567813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1457f2-940c-48d8-ad83-91a606485d7c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:21.572419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:21.573712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.574593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.574593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.575207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:21.577158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:21.679161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 948/1897] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:21 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:21.681259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:21.699867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9963b-414d-4c3f-be3b-765b217ad696 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:21.800932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:21.801640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.801991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.802191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.802878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:21.804805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:21.931522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 950/1898] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:21 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:21.935618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:21.946375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb68290-0903-42dc-bb54-745a375c9248 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:21.957878 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:21.958702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:21.959082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:21.959455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:21.960472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:21.962661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:21.982352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 949/1899] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:21.984574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:22.002303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479b27a-3c75-4ee2-8732-5ba3d749daf4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:22.008127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:22.008797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:22.009448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:22.009789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:22.010847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:22.013034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e8dcb-21a5-44ef-b4d2-4490bf124712 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:22.033113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 951/1900] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:22.033850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:22.045794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08bd98-21fb-4c29-9b45-28c865d10867 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:22.051489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:22.052381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:22.052659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:22.052931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] PATH_INFO: `/v3/projects/548689fd30d64c928e5f6c883afc09a2/users/f2a441ce0941447e91a32a8973d921c6/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:22.078633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548689fd30d64c928e5f6c883afc09a2, user_id=f2a441ce0941447e91a32a8973d921c6, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:22.081349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:22.185332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 950/1901] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:22 2022] PUT /identity/v3/projects/548689fd30d64c928e5f6c883afc09a2/users/f2a441ce0941447e91a32a8973d921c6/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:22.190744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:22.191039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:22.191626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:22.233078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:22.234611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:22.323308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 952/1902] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:22.329654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:22.331637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:22.413357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224cd43-22bc-47a0-8b81-7460080ef0e5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:22.428619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:22.429568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:22.429922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:22.430301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:22.448089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:22.450107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7d2c6-4791-4739-bcd5-cdc945fd4035 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:22.468684 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 951/1903] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:22.626243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:22.628349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:22.759344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0da94-b004-4d8b-a232-f148375fde89 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:22.768275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:22.769311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:22.769809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:22.770273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:22.773032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:22.884803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:22.888374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:22.899208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 953/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:24.275880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:24.276433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:24.276669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:24.306352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] MFA Rules not processed for user `f2a441ce0941447e91a32a8973d921c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:24.309005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:24.422690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 952/1905] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:24.501172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:24.502711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:24.514234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86a0b0-4d86-4784-b90c-de4137a9988c service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:24.517954 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:24.518601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:24.518889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:24.519168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:24.527669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:24.529343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:24.538450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 954/1906] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:24.867232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:24.879014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561ba75-9e40-4914-9e7d-6983100c9ff1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:24.882847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:24.883595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:24.884049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:24.884397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:24.886445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:24.954123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:24.955564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d5d86-2196-4da8-a03a-6a266bcb152e service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:24.967609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 953/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:25.911755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:25.913245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:25.932826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fa038-4364-48a0-9f11-d979a14c5457 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:25.932826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:25.933389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:25.933674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:25.933947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] PATH_INFO: `/v3/users/d9aa87fa65804206bd9f9f2d595c1715` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:25.935133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9aa87fa65804206bd9f9f2d595c1715)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:25.937136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:26.131928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9aa87fa65804206bd9f9f2d595c1715'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:26.132581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9aa87fa65804206bd9f9f2d595c1715'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:26.140617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9aa87fa65804206bd9f9f2d595c1715'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:26.241530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9aa87fa65804206bd9f9f2d595c1715'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:26.242152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cd74bb22-713a-49e2-8bc8-b37c7825b6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9aa87fa65804206bd9f9f2d595c1715'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:26.276741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 955/1908] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:25 2022] DELETE /identity/v3/users/d9aa87fa65804206bd9f9f2d595c1715 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:26.283219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:26.283674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:26.283927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:26.288408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:26.288703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:26.289240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:26.302596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:26.304014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:26.306327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] MFA Rules not processed for user `f2a441ce0941447e91a32a8973d921c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:26.307689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:26.365028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 956/1909] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:26.365675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 954/1910] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:26.378169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:26.379684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:26.437895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcb74-97d5-45ff-8bda-f983b7ddc02e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:26.441823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:26.442546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:26.442857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:26.443156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:26.453553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:26.455001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:26.464765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 957/1911] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:27.325352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:27.325352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:27.349007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6caca9-fdd9-4d2b-aaf2-5e6e623112e8 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:27.357305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:27.359325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:27.359798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:27.360266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] PATH_INFO: `/v3/projects/80acb009468447649befeae03b6435bc` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:27.363796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80acb009468447649befeae03b6435bc)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:27.366461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:27.485666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:27.487078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:27.500443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a80f0a-7ed8-4fa4-ab22-a1286cccabc9 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:27.505244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:27.506116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:27.506392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:27.506668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] PATH_INFO: `/v3/users/eda7f9be6e924c6cba0a67cbb3c01052` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:27.507867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda7f9be6e924c6cba0a67cbb3c01052)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:27.509819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:27.549978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80acb009468447649befeae03b6435bc', 'request_id': 'req-b0997aa3-589b-4d8e-b78f-b702f5d904f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.555327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80acb009468447649befeae03b6435bc', 'request_id': 'req-b0997aa3-589b-4d8e-b78f-b702f5d904f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.644562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80acb009468447649befeae03b6435bc', 'request_id': 'req-b0997aa3-589b-4d8e-b78f-b702f5d904f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.658102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] The token cache is being invalidate because project 80acb009468447649befeae03b6435bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:27.658390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.659028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.660759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 955/1912] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:27 2022] DELETE /identity/v3/projects/80acb009468447649befeae03b6435bc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:27.664605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:27.666682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:27.729220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0997aa3-589b-4d8e-b78f-b702f5d904f6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:27.734599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:27.735501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:27.735787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:27.736059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] PATH_INFO: `/v3/users/26effd9db2d248028d4893b4f51a60f3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:27.737300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26effd9db2d248028d4893b4f51a60f3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:27.738582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda7f9be6e924c6cba0a67cbb3c01052'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.739232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda7f9be6e924c6cba0a67cbb3c01052'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.739344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:27.746565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda7f9be6e924c6cba0a67cbb3c01052'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.830291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda7f9be6e924c6cba0a67cbb3c01052'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.831025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-63de28eb-d060-4845-9f9f-aa002e8b2b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda7f9be6e924c6cba0a67cbb3c01052'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.855832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 958/1913] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:27 2022] DELETE /identity/v3/users/eda7f9be6e924c6cba0a67cbb3c01052 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:27.855832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:27.855832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:27.855832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:27.873598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:27.874851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:27.935802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 959/1914] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:27.944252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26effd9db2d248028d4893b4f51a60f3'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.946209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:27.947677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:27.951723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26effd9db2d248028d4893b4f51a60f3'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:27.952520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26effd9db2d248028d4893b4f51a60f3'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.005580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af798a1-aedb-4288-860c-6ce32b9f4645 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:28.011131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:28.011929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:28.012314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:28.013172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:28.023650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:28.028605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:28.038545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 960/1915] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:28.075604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26effd9db2d248028d4893b4f51a60f3'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.076535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26effd9db2d248028d4893b4f51a60f3'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.096259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 956/1916] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:27 2022] DELETE /identity/v3/users/26effd9db2d248028d4893b4f51a60f3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:28.535802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:28.537561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:28.551664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dd5b9-854f-444a-a875-ddac08966fcc service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:28.615782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:28.617782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:28.617905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:28.618736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:28.619057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:28.619909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] PATH_INFO: `/v3/projects/dd992f281b774ce88c3dfd119e87f968` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:28.621305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd992f281b774ce88c3dfd119e87f968)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:28.623222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:28.636209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eedb3-be53-4c51-8fbc-884227dcc7a5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:28.641873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:28.642986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:28.643440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:28.643851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] PATH_INFO: `/v3/projects/58e470e514b84fac97cca0820316abe4` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:28.645283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e470e514b84fac97cca0820316abe4)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:28.648717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:28.759088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd992f281b774ce88c3dfd119e87f968', 'request_id': 'req-715f8aac-f24b-4604-b2a7-9b6baf39969e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.765664 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd992f281b774ce88c3dfd119e87f968', 'request_id': 'req-715f8aac-f24b-4604-b2a7-9b6baf39969e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.783921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e470e514b84fac97cca0820316abe4', 'request_id': 'req-16ddbb91-8d48-4387-a7fa-e192572015f7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.789490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e470e514b84fac97cca0820316abe4', 'request_id': 'req-16ddbb91-8d48-4387-a7fa-e192572015f7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.847371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd992f281b774ce88c3dfd119e87f968', 'request_id': 'req-715f8aac-f24b-4604-b2a7-9b6baf39969e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.859980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] The token cache is being invalidate because project dd992f281b774ce88c3dfd119e87f968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:28.860279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.860894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.862490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 961/1917] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:28 2022] DELETE /identity/v3/projects/dd992f281b774ce88c3dfd119e87f968 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:28.866376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:28.867650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:28.921406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e470e514b84fac97cca0820316abe4', 'request_id': 'req-16ddbb91-8d48-4387-a7fa-e192572015f7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.930389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f8aac-f24b-4604-b2a7-9b6baf39969e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:28.933685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] The token cache is being invalidate because project 58e470e514b84fac97cca0820316abe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:28.934006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.934653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-16ddbb91-8d48-4387-a7fa-e192572015f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:28.936449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 957/1918] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:28 2022] DELETE /identity/v3/projects/58e470e514b84fac97cca0820316abe4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:28.941020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa2db-7cb8-4d90-ba27-d9c9d6d21f63 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:28.941343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa2db-7cb8-4d90-ba27-d9c9d6d21f63 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:28.941620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa2db-7cb8-4d90-ba27-d9c9d6d21f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:28.959120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4c4aa2db-7cb8-4d90-ba27-d9c9d6d21f63 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:28.960345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4c4aa2db-7cb8-4d90-ba27-d9c9d6d21f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:28.988216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:28.989159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:28.989428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:28.989708 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] PATH_INFO: `/v3/users/a6b9f074cba847cd9edd399d517c378d` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:28.991342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b9f074cba847cd9edd399d517c378d)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:28.993395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.027608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 958/1919] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:29.035741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.036112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.036399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.055155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:29.056365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:29.065824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 959/1920] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:29.070088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.079005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042545b8-d705-4a42-a5dd-9d98749e5022 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.083668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.084324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.084601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.084873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.085621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:29.085926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.087509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.100268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 960/1921] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:59:29.104510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.114827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8c31a-9701-4900-83ad-e684e043923a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.120670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.121403 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.121691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.121968 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.122658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.124621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.233149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 961/1922] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:29.234224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.235681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b9f074cba847cd9edd399d517c378d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.236217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b9f074cba847cd9edd399d517c378d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.243364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b9f074cba847cd9edd399d517c378d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.295287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95e85-aa5d-4d9a-9fbf-44e7f377e90e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.299969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.300739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.301023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.301337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.302042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.304076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.315323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b9f074cba847cd9edd399d517c378d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.315946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b9f074cba847cd9edd399d517c378d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.333414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 962/1923] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:28 2022] DELETE /identity/v3/users/a6b9f074cba847cd9edd399d517c378d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:29.408256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 962/1924] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:29 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:29.412318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.414283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:29.481146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e2414-a184-45b9-bd15-3af6a2d07379 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.486056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.486728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.487017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.487298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.488154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.489868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.501794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 963/1925] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:29.505945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.516350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6b1c-0d4c-4008-a6d3-5a9a762e2f90 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.521462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.522224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.522579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.523387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.523717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.528328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553667a-a229-486f-b8bf-cde148791423 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.537375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 963/1926] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:29.541855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.557669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8d00-89b1-4b62-b54a-f0c1a7810528 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.561372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.562593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.563048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.563476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] PATH_INFO: `/v3/projects/8c85954bb270402fa9aa8da8593df14c/users/4d969b8812fd4c3881ad6bb7388a2a03/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.581555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c85954bb270402fa9aa8da8593df14c, user_id=4d969b8812fd4c3881ad6bb7388a2a03, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.584528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.668350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 964/1927] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:29 2022] PUT /identity/v3/projects/8c85954bb270402fa9aa8da8593df14c/users/4d969b8812fd4c3881ad6bb7388a2a03/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:29.679459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.679948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.680037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.706254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] MFA Rules not processed for user `4d969b8812fd4c3881ad6bb7388a2a03`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:29.707449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:29.743085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.745292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:29.776383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 964/1928] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:29.780741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.812362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfe7ef-f258-4866-9303-a19111e3f330 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.817674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.818535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.818817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.819219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] PATH_INFO: `/v3/projects/18139a4d2f7d42f7b98a0f27494add12` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.820579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18139a4d2f7d42f7b98a0f27494add12)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.825747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.845723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd316e4-56e2-40e6-aa5c-9c66e25863a6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:29.851810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:29.852626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:29.852905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:29.853350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:29.854782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:29.856568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:29.945068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18139a4d2f7d42f7b98a0f27494add12', 'request_id': 'req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.951578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18139a4d2f7d42f7b98a0f27494add12', 'request_id': 'req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:29.960130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 965/1929] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:29 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:29.960965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:29.962663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.025833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab6e8b-09b0-4dd6-bea5-1fab26340a1e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.027340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18139a4d2f7d42f7b98a0f27494add12', 'request_id': 'req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.030629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.031504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.031783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.032056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] PATH_INFO: `/v3/users/285ea9b351af4937a24028c09a4477c8` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.033291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285ea9b351af4937a24028c09a4477c8)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.035202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.039082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] The token cache is being invalidate because project 18139a4d2f7d42f7b98a0f27494add12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:30.044317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.044317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.044317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 965/1930] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:29 2022] DELETE /identity/v3/projects/18139a4d2f7d42f7b98a0f27494add12 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:30.044317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.044623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.106131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d945d22-e5d5-4ada-8fd4-a5eb5f2f54f8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.110905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.111566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.111849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.112126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.112833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.114823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bc95a-8fb4-4114-9b98-533ec063faa2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.218657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 966/1931] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:30.219922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.220216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.220497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.238923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285ea9b351af4937a24028c09a4477c8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.240036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:30.241424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.263145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285ea9b351af4937a24028c09a4477c8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.263145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285ea9b351af4937a24028c09a4477c8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.263449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 967/1932] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:30.263449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.263449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3031b-b052-4ac6-ba91-be1d2f1d6d53 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.272445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.273174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.273461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.273735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.274531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.276894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea8f5-6540-4d86-a715-0c43f939026e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.288091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 968/1933] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:30.289389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.289684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.292572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.308924 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:30.310177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.318015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 969/1934] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:30.318771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.338409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14c2f-3acd-4354-80c3-d9bcb46a7b0c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.338409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.338409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.338409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.338725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] PATH_INFO: `/v3/projects/dda6fed78739452fa40c100650194f48/users/a830ee08bd65488db65704dbed0f6245/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.351689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda6fed78739452fa40c100650194f48, user_id=a830ee08bd65488db65704dbed0f6245, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.355053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dde9b2-1cb4-4a19-8155-3ef6fcead905 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.378227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285ea9b351af4937a24028c09a4477c8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.378227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285ea9b351af4937a24028c09a4477c8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:30.379109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 966/1935] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:29 2022] DELETE /identity/v3/users/285ea9b351af4937a24028c09a4477c8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:30.385447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.386861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.450296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67e7-20e2-4349-808d-946be5ee7581 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.455902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.456569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.459520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.459520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.459520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:30.459520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.459931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.461784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 970/1936] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:30 2022] PUT /identity/v3/projects/dda6fed78739452fa40c100650194f48/users/a830ee08bd65488db65704dbed0f6245/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:30.466351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.466351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.466351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.475620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 967/1937] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:30.476326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.478019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.481974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:30.484953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.490930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a576c-d92c-48d7-8837-2286cd87cdff admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.543613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 971/1938] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:30.544440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.546061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.546974 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.547333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.547519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.548241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.549880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.553627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91a510-486b-47dd-8b36-2f6d109f8573 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.559041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.559706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.559994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.560276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.562492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.562612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 968/1939] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:30.562612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.562959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.564907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.620704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3d6e-3739-4eae-b31b-b14f6a823953 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.624412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.625087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.625375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.625653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.635116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.636072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.646123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 969/1940] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:30.646825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.662832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834171-0721-4255-89c9-4fe0d6c2fd94 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.664335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.665273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.666731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.667073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] PATH_INFO: `/v3/projects/dda6fed78739452fa40c100650194f48/users/a830ee08bd65488db65704dbed0f6245/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.669270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda6fed78739452fa40c100650194f48, user_id=a830ee08bd65488db65704dbed0f6245, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.672294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650cc8cf-6ace-49a2-96af-73a6f408869f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.685288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 970/1941] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:30 2022] PUT /identity/v3/projects/dda6fed78739452fa40c100650194f48/users/a830ee08bd65488db65704dbed0f6245/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:30.694179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 972/1942] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:30.696246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.697501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.697501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.700300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.736985 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] MFA Rules not processed for user `a830ee08bd65488db65704dbed0f6245`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:30.739091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.785707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83283dd-e56c-49b2-ad5e-36f086a298fc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.792127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.793227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.793725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.794265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.795186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.797385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.824099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 971/1943] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:30.836393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.838912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:30.899670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 973/1944] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:30 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:30.902657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.910387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266d9ed-5a4f-4d8d-b892-52a5bf332339 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.913878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dbc1d-edfe-40c6-bede-1215fdb06b7c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.914126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.914787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.915090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.915374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.929209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.930662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.943503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 972/1945] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:30.944286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.945327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.950791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.950791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.950791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.954551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:30.972303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.976473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 974/1946] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:30.984611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e667-0a39-40e8-8325-22356d29c110 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:30.990450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:30.991490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00483261-dbe7-4475-9748-28157491347d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:30.992368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483261-dbe7-4475-9748-28157491347d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:30.992651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483261-dbe7-4475-9748-28157491347d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:30.992928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00483261-dbe7-4475-9748-28157491347d admin admin] PATH_INFO: `/v3/users/4d969b8812fd4c3881ad6bb7388a2a03` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:30.994242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483261-dbe7-4475-9748-28157491347d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d969b8812fd4c3881ad6bb7388a2a03)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:30.996240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00483261-dbe7-4475-9748-28157491347d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.012810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2606e0c-ed63-4f44-a3f6-390271baff49 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.019177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.019858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.020149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.020432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.021201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.022973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.034741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 975/1947] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:31.039046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.048563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd22b90-0248-43f1-b979-0b64b3b0ba9c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.053113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.053973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.054937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.055255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] PATH_INFO: `/v3/projects/40823c4241644ee4ba718ef8fd951efe/users/1acc0c1f912c4990b374a83ba711504f/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.071151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40823c4241644ee4ba718ef8fd951efe, user_id=1acc0c1f912c4990b374a83ba711504f, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.074812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.173123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 976/1948] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:31 2022] PUT /identity/v3/projects/40823c4241644ee4ba718ef8fd951efe/users/1acc0c1f912c4990b374a83ba711504f/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:31.174032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.175583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.205988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-00483261-dbe7-4475-9748-28157491347d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d969b8812fd4c3881ad6bb7388a2a03'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.213143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-00483261-dbe7-4475-9748-28157491347d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d969b8812fd4c3881ad6bb7388a2a03'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.214011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-00483261-dbe7-4475-9748-28157491347d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d969b8812fd4c3881ad6bb7388a2a03'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.238158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ddf0a-b396-4bde-96a1-18504aa0b39b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.242949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.243790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.244091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.244362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] PATH_INFO: `/v3/projects/22339cbeb73742a6bc63c3f7e355b0e8` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.245555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=22339cbeb73742a6bc63c3f7e355b0e8)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.247450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.278470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-00483261-dbe7-4475-9748-28157491347d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d969b8812fd4c3881ad6bb7388a2a03'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.279120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-00483261-dbe7-4475-9748-28157491347d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d969b8812fd4c3881ad6bb7388a2a03'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.297335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 973/1949] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:30 2022] DELETE /identity/v3/users/4d969b8812fd4c3881ad6bb7388a2a03 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:31.298594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bf0-5c07-4700-a282-7d49a214e602 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.298884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bf0-5c07-4700-a282-7d49a214e602 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.299162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d7bf0-5c07-4700-a282-7d49a214e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.325613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-518d7bf0-5c07-4700-a282-7d49a214e602 None None] MFA Rules not processed for user `1acc0c1f912c4990b374a83ba711504f`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:31.326821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-518d7bf0-5c07-4700-a282-7d49a214e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.362761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22339cbeb73742a6bc63c3f7e355b0e8', 'request_id': 'req-f0386e5f-0762-4e35-b624-f4ef0d2c796c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.368172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22339cbeb73742a6bc63c3f7e355b0e8', 'request_id': 'req-f0386e5f-0762-4e35-b624-f4ef0d2c796c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.395973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 974/1950] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:31.397485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.397775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.398052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.419209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:31.420356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.447234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22339cbeb73742a6bc63c3f7e355b0e8', 'request_id': 'req-f0386e5f-0762-4e35-b624-f4ef0d2c796c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.460102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] The token cache is being invalidate because project 22339cbeb73742a6bc63c3f7e355b0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:31.460399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.461130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.466373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 977/1951] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:31 2022] DELETE /identity/v3/projects/22339cbeb73742a6bc63c3f7e355b0e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:31.466373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.466596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.484427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 975/1952] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:31.488098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.489504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.502186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883d19-e1e1-4902-86f2-79d530207f95 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.506980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.507930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.508214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.508545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] PATH_INFO: `/v3/users/18707b33985442afbf717fb6d6ca3a93` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.510592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18707b33985442afbf717fb6d6ca3a93)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.513941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.544775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0386e5f-0762-4e35-b624-f4ef0d2c796c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.550880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.551797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.552252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.552713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.553459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.555413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.647088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 978/1953] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:31 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:31.647088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.647088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:31.701496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe44279-91f9-4e61-989f-1eba9d2d7c37 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.705124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.705778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.706063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.706336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.709758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18707b33985442afbf717fb6d6ca3a93'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.718224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18707b33985442afbf717fb6d6ca3a93'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.719113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18707b33985442afbf717fb6d6ca3a93'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.767233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.768691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.778960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 979/1954] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:31.779748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.788765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e04284-b7de-4a5e-a605-8e916752eb77 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:31.793341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18707b33985442afbf717fb6d6ca3a93'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.794130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18707b33985442afbf717fb6d6ca3a93'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:31.799527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:31.802744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:31.802744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:31.802744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:31.802744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:31.803944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:31.816519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 976/1955] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:31 2022] DELETE /identity/v3/users/18707b33985442afbf717fb6d6ca3a93 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:31.906379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 980/1956] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:31 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:31.909811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:31.912579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.009961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c11523-571f-4fc2-9770-525734862837 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.016500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.017363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.017780 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.018176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.019071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.023121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.055710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 977/1957] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:32.065351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.079540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea244dc-fbe3-4665-be31-bca76c061ad3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.085755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.087295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.089334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.089929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] PATH_INFO: `/v3/projects/e00b0700ba4e432995db0e7f8ff616cf/users/ee3684251bb8490da8d940d2eb4cf40e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.108833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00b0700ba4e432995db0e7f8ff616cf, user_id=ee3684251bb8490da8d940d2eb4cf40e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.111660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.214235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 981/1958] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:32 2022] PUT /identity/v3/projects/e00b0700ba4e432995db0e7f8ff616cf/users/ee3684251bb8490da8d940d2eb4cf40e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:32.218016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.232170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130300f-f279-47a7-a670-a229b5ed089d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.306964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.307636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.307949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.308283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.309073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.310677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.320964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 978/1959] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:32.325851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.336460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89da914-1cc1-46df-92e9-0999aebd13dc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.340506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.342228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.343819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.344878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.345212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.345559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] PATH_INFO: `/v3/projects/e00b0700ba4e432995db0e7f8ff616cf/users/ee3684251bb8490da8d940d2eb4cf40e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.362439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81945a5-6bd3-405c-ac6c-a41bd9a7978b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.370128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.371931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.372656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.373253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] PATH_INFO: `/v3/projects/8c85954bb270402fa9aa8da8593df14c` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.374525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c85954bb270402fa9aa8da8593df14c)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.374636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00b0700ba4e432995db0e7f8ff616cf, user_id=ee3684251bb8490da8d940d2eb4cf40e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.376642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.377582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.389950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 982/1960] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:32 2022] PUT /identity/v3/projects/e00b0700ba4e432995db0e7f8ff616cf/users/ee3684251bb8490da8d940d2eb4cf40e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:32.399241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.404085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.480053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cdf1-ca97-48c2-be25-199c7302b8c3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.484759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.485585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.485866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.486138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] PATH_INFO: `/v3/projects/e75dd4dd799143d0b4cdda89f01a44a7` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.487322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75dd4dd799143d0b4cdda89f01a44a7)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.489257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.512989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c85954bb270402fa9aa8da8593df14c', 'request_id': 'req-123d1db0-e852-49e3-92b1-3e0b258b4be0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.519166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c85954bb270402fa9aa8da8593df14c', 'request_id': 'req-123d1db0-e852-49e3-92b1-3e0b258b4be0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.600407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75dd4dd799143d0b4cdda89f01a44a7', 'request_id': 'req-7d2ea273-e4cd-4cf5-8d87-19f764955d32'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.607007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c85954bb270402fa9aa8da8593df14c', 'request_id': 'req-123d1db0-e852-49e3-92b1-3e0b258b4be0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.607841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75dd4dd799143d0b4cdda89f01a44a7', 'request_id': 'req-7d2ea273-e4cd-4cf5-8d87-19f764955d32'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.622217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] The token cache is being invalidate because project 8c85954bb270402fa9aa8da8593df14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:32.622473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.623295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-123d1db0-e852-49e3-92b1-3e0b258b4be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.625818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 979/1961] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:32 2022] DELETE /identity/v3/projects/8c85954bb270402fa9aa8da8593df14c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:32.633904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.633904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.633904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.661960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] MFA Rules not processed for user `ee3684251bb8490da8d940d2eb4cf40e`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:32.663631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.673861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75dd4dd799143d0b4cdda89f01a44a7', 'request_id': 'req-7d2ea273-e4cd-4cf5-8d87-19f764955d32'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.699368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] The token cache is being invalidate because project e75dd4dd799143d0b4cdda89f01a44a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:32.699665 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.700401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:32.702417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 983/1962] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:32 2022] DELETE /identity/v3/projects/e75dd4dd799143d0b4cdda89f01a44a7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:32.703503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.704876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.772817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 980/1963] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:32.773964 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:32.776309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:32.791743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ea273-e4cd-4cf5-8d87-19f764955d32 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.797150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.797822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f240-99f3-4912-867e-03e36a29f218 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:32.798437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.798810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.799363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] PATH_INFO: `/v3/users/a830ee08bd65488db65704dbed0f6245` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.800908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a830ee08bd65488db65704dbed0f6245)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.803221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:32.803979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:32.807139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:32.807139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] PATH_INFO: `/v3/users/9e5a376bc97b4699bc43dbe360181150` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:32.807428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:32.807507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5a376bc97b4699bc43dbe360181150)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:32.808635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:33.049325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a830ee08bd65488db65704dbed0f6245'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.049897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a830ee08bd65488db65704dbed0f6245'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.056630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a830ee08bd65488db65704dbed0f6245'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.089417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5a376bc97b4699bc43dbe360181150'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.108645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5a376bc97b4699bc43dbe360181150'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.109829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5a376bc97b4699bc43dbe360181150'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.150547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a830ee08bd65488db65704dbed0f6245'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.152017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a830ee08bd65488db65704dbed0f6245'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.173710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 984/1964] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:32 2022] DELETE /identity/v3/users/a830ee08bd65488db65704dbed0f6245 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:33.174918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:33.176341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:33.227649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5a376bc97b4699bc43dbe360181150'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.229824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5a376bc97b4699bc43dbe360181150'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:33.251836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523f9d-1321-456c-85db-dee4e8c51bbe admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:33.262870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 981/1965] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:32 2022] DELETE /identity/v3/users/9e5a376bc97b4699bc43dbe360181150 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:33.265890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:33.267259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:33.267793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:33.268276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:33.271725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:33.364869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:33.366494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:33.378048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 985/1966] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:33.777228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:33.778683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:33.861463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074a715-563d-4f6c-a954-1ebaf31a1f4d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:33.866633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:33.867518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:33.867802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:33.868081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] PATH_INFO: `/v3/projects/dda6fed78739452fa40c100650194f48` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:33.869930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda6fed78739452fa40c100650194f48)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:33.872795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:33.888167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:33.889835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:33.980781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b40cf-0494-4215-bec2-05a0134eaf0d service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:33.986740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:33.986740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:33.986740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:33.987332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] PATH_INFO: `/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:33.988195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0d2a35eea94041bc78270b8c7c89f8)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:33.990172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.057797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda6fed78739452fa40c100650194f48', 'request_id': 'req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.063034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda6fed78739452fa40c100650194f48', 'request_id': 'req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.142070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda6fed78739452fa40c100650194f48', 'request_id': 'req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.158006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] The token cache is being invalidate because project dda6fed78739452fa40c100650194f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:34.158302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.160373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0947e73f-a034-42c7-a44f-bf0fcd87d2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.162310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 982/1967] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:33 2022] DELETE /identity/v3/projects/dda6fed78739452fa40c100650194f48 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:34.168193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ac66-9984-47d8-8e6d-6576b21b136d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.168649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ac66-9984-47d8-8e6d-6576b21b136d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.168837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ac66-9984-47d8-8e6d-6576b21b136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.170197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0d2a35eea94041bc78270b8c7c89f8', 'request_id': 'req-57aa3966-2312-4b48-be51-f729895c310e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.176007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0d2a35eea94041bc78270b8c7c89f8', 'request_id': 'req-57aa3966-2312-4b48-be51-f729895c310e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.187713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9674ac66-9984-47d8-8e6d-6576b21b136d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:34.188923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9674ac66-9984-47d8-8e6d-6576b21b136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.254629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 983/1968] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:34.256249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.256536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.256811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.261771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0d2a35eea94041bc78270b8c7c89f8', 'request_id': 'req-57aa3966-2312-4b48-be51-f729895c310e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.274935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] The token cache is being invalidate because project bb0d2a35eea94041bc78270b8c7c89f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:34.276137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:34.276335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.276833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-57aa3966-2312-4b48-be51-f729895c310e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.277772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.278634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 986/1969] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:33 2022] DELETE /identity/v3/projects/bb0d2a35eea94041bc78270b8c7c89f8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:34.285300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c1b70-63bd-480d-b58e-f06dd0a97073 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.285300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c1b70-63bd-480d-b58e-f06dd0a97073 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.285300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c1b70-63bd-480d-b58e-f06dd0a97073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.293352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 984/1970] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:34.297570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.313423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5071691-2a1e-4cea-9599-f13b7e8ebbf1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.313581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-421c1b70-63bd-480d-b58e-f06dd0a97073 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:34.313581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-421c1b70-63bd-480d-b58e-f06dd0a97073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.315808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.316648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.316951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.317233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.317955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:34.318370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.320839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 987/1971] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:34.320966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.328637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.328931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.329254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.350405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:34.351852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.352861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 985/1972] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:34.357646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.363480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 988/1973] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:34.370425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.373143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d30022-ff99-4f91-a510-fcaee5ea3037 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.379166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.380096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.381253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.381372 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52853ee-6251-4385-b55d-3458eee8edaf None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.381820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.382726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.385897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.386926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.387869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.390386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.390386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.390386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:34.390616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.392453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.407188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 989/1974] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:34.411786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.422295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb67f7-9e22-4f1e-b626-be80b6e8589b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.428267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.429191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.429760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.429760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.430438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.433023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.550996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 986/1976] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/projects => generated 401 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:34.551143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 990/1976] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:34.551849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.555110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.555430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.615730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68006d9-abb6-4a80-b416-81b9a23fd4f0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.619944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4d1bb-ca33-43e8-af33-15316609c929 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.623477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.624158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.624504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.624725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.625447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.626035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.626897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.627176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.627492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.627596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] PATH_INFO: `/v3/users/1acc0c1f912c4990b374a83ba711504f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.628729 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1acc0c1f912c4990b374a83ba711504f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.630674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.738779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 987/1977] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:34.739771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.750717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2dc28-741c-488b-9fae-3d1e3dc07282 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.755546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.756243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.756528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.756805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.757605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.759791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.818138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1acc0c1f912c4990b374a83ba711504f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.818819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1acc0c1f912c4990b374a83ba711504f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.825629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1acc0c1f912c4990b374a83ba711504f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.838617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 988/1978] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:34.839450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.849028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45680af3-a079-4569-b8b4-67e6da79bee6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.854504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.855195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.855480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.855764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.856485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.858147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.871594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 989/1979] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:34.871594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.872464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1acc0c1f912c4990b374a83ba711504f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.873209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1acc0c1f912c4990b374a83ba711504f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:34.881785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59281154-8343-4fd5-8cdb-6ad7f0236470 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.888207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.889118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.889473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.889823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.890625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.892161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 991/1980] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:34 2022] DELETE /identity/v3/users/1acc0c1f912c4990b374a83ba711504f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:34.892615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50502083-b26d-4c8d-9541-cdb986ac40e2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.893654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.894972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.906344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 990/1981] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:34.907829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.908182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.908521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.928424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:34.929657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.962337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696ffee-c299-49f9-82cc-f2768311f7ba admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:34.968015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:34.968696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:34.968981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:34.972887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:34.972887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:34.972887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:34.984427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 992/1982] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:34.986093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:34.988973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:34.997649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 991/1983] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:34.998805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.005420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8af6c3-e4d6-4efd-9295-749fe84d45fb admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.008502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080033d6-bd9d-4c39-89b1-79c66b5d0098 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.010802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.011474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.011768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.012056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.013048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.013804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.014668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.014785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.014989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.015268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] PATH_INFO: `/v3/projects/3083665fd23c4ff4acb758314f4d75bf/users/fd413521191e41d284f177949ced57e1/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.025846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 993/1984] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:35.026686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.028330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.032796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3083665fd23c4ff4acb758314f4d75bf, user_id=fd413521191e41d284f177949ced57e1, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.035652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774cf0-dd5b-4a91-813a-f7f94b70906b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.084639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309dc2a-c325-4b9a-9657-9b096d06f18e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.088616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.089292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.089584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.089866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.099128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.100589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.110727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 994/1985] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:35.111850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.127396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8bf8c-33f1-4993-b6af-3732d50c59ca service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.131066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.132028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.132311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.132589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] PATH_INFO: `/v3/projects/0ad66a5e7b064055b3e730033dbfc2ed/users/8a64e3ed20664767b7de772eee23a46f/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.155046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 992/1986] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:34 2022] PUT /identity/v3/projects/3083665fd23c4ff4acb758314f4d75bf/users/fd413521191e41d284f177949ced57e1/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:35.155764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad66a5e7b064055b3e730033dbfc2ed, user_id=8a64e3ed20664767b7de772eee23a46f, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.158697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a5334-17cf-42be-8c9f-00839100e571 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.166416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.166702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.167474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.195220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] MFA Rules not processed for user `fd413521191e41d284f177949ced57e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:35.196439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.250840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 995/1987] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:35 2022] PUT /identity/v3/projects/0ad66a5e7b064055b3e730033dbfc2ed/users/8a64e3ed20664767b7de772eee23a46f/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:35.261381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.261675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.261958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.272111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 993/1988] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:35.288178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.288178 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.289878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] MFA Rules not processed for user `8a64e3ed20664767b7de772eee23a46f`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:35.291710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.359782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998c25-ae37-4163-a867-44a24b7e7df7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.363149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 996/1989] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:35.368645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.422126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.422799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.423082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.423356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.463695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bb595-cff5-4464-89a1-ceeaf2acebd6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.471033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.471795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.472157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.472510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.473343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.475637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.487819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.489423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.499238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 994/1990] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:35.527550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.540936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86a7-4471-475a-8490-0f0417815f2c service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.546920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.550652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.550652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.550652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] PATH_INFO: `/v3/users/fd413521191e41d284f177949ced57e1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.550652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd413521191e41d284f177949ced57e1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.554262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 997/1991] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:35 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:35.557533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.558557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.638516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea677f-0e8c-4cc2-b098-90c439a60ba5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.644029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.644821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.645207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.645503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.646189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.648293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.745831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 998/1992] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:35 2022] POST /identity/v3/users => generated 307 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:35.745831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.748115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.776793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebf491-72bd-41ed-a50f-23cbbf844354 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:35.782489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:35.783852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:35.785354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:35.785354 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] PATH_INFO: `/v3/projects/40823c4241644ee4ba718ef8fd951efe` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:35.786124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40823c4241644ee4ba718ef8fd951efe)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:35.788050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:35.797660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd413521191e41d284f177949ced57e1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.807075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd413521191e41d284f177949ced57e1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.808112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd413521191e41d284f177949ced57e1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.874183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd413521191e41d284f177949ced57e1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.875346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd413521191e41d284f177949ced57e1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.900828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 995/1993] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:35 2022] DELETE /identity/v3/users/fd413521191e41d284f177949ced57e1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:35.900828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:35.901492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:35.930228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40823c4241644ee4ba718ef8fd951efe', 'request_id': 'req-ae000ccf-7007-4fd2-ab0e-753fc532c22a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.943843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40823c4241644ee4ba718ef8fd951efe', 'request_id': 'req-ae000ccf-7007-4fd2-ab0e-753fc532c22a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:35.989250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3d9a4-10d9-4dfe-a451-0aac347752cf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.015487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40823c4241644ee4ba718ef8fd951efe', 'request_id': 'req-ae000ccf-7007-4fd2-ab0e-753fc532c22a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.033767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] The token cache is being invalidate because project 40823c4241644ee4ba718ef8fd951efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:36.034269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.035490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ae000ccf-7007-4fd2-ab0e-753fc532c22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.042367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 999/1994] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:35 2022] DELETE /identity/v3/projects/40823c4241644ee4ba718ef8fd951efe => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:36.044289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.044745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.045196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.062839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.066509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.066509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.066509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.066509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.068893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.070255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:36.071710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.089416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1000/1995] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:36.089416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.089705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 996/1996] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:36.089795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.093101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.095045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.109563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9170a5-27a8-492c-a951-866d8e713393 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.110467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348adb3d-135c-4f68-bbee-df1d9a7e1262 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.115143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.116026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.116159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.116361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.116598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] PATH_INFO: `/v3/users/ee3684251bb8490da8d940d2eb4cf40e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.117058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.117858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3684251bb8490da8d940d2eb4cf40e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.118412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.120289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] PATH_INFO: `/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f/users/50687934720a45768de16c4a14c730ba/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.120525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.136806 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241f1c89abd24fc5a4311675ba7e6b6f, user_id=50687934720a45768de16c4a14c730ba, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.140123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.227397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 997/1997] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:36 2022] PUT /identity/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f/users/50687934720a45768de16c4a14c730ba/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:36.231666 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.233308 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.292078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb747a-ae40-4053-803f-7d6be2107f10 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.295863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.296551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.296839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.297153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.325154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3684251bb8490da8d940d2eb4cf40e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.342121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3684251bb8490da8d940d2eb4cf40e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.363994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3684251bb8490da8d940d2eb4cf40e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.372940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.374523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.385473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 998/1998] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:36.386391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.399912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf82cd-7b10-4f65-bb19-98d599c39fa8 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.405836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.406590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.406939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.407280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.408142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.410005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.426216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 999/1999] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:36.427418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3684251bb8490da8d940d2eb4cf40e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.427733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.427859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1843b941-a935-4179-aced-e480d6d8569e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3684251bb8490da8d940d2eb4cf40e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:36.430314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.451774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6b88-eb6f-42a7-a07a-a2e3899b5023 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.457829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1001/2000] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:36 2022] DELETE /identity/v3/users/ee3684251bb8490da8d940d2eb4cf40e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:36.464419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.465540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.466083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.466416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] PATH_INFO: `/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f/users/50687934720a45768de16c4a14c730ba/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.468664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=241f1c89abd24fc5a4311675ba7e6b6f, user_id=50687934720a45768de16c4a14c730ba, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.473645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.493562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1000/2001] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:36 2022] PUT /identity/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f/users/50687934720a45768de16c4a14c730ba/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:36.501311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.501607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.501897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.531156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] MFA Rules not processed for user `50687934720a45768de16c4a14c730ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:36.532604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.608185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1002/2002] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:36.615855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.617615 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.682696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba3c69-2bd8-43cf-97b5-6f694e6cdf5d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.686400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.687055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.687335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.687606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.699631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:36.701340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:36.713311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1001/2003] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:36.929798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.939578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1edbe4-2dbe-46d0-b823-cac0a9588cdb None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:36.943175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:36.943817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:36.944101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:36.944376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:36.946188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:36.990623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:36.992715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.014669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.016113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.030449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1003/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:37.031235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.032852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.097053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18276924-8764-47b3-ace5-bdcf6b16ed85 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.102546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.103767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adaf2a-d5a3-4f79-8b48-0beda596c56b service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.104287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.104756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.105282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] PATH_INFO: `/v3/projects/e00b0700ba4e432995db0e7f8ff616cf` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.106299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00b0700ba4e432995db0e7f8ff616cf)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.108239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.110652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.111571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.111850 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.112124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] PATH_INFO: `/v3/projects/3083665fd23c4ff4acb758314f4d75bf` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.113338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3083665fd23c4ff4acb758314f4d75bf)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.115240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.247213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00b0700ba4e432995db0e7f8ff616cf', 'request_id': 'req-009e7a05-524d-47fd-8507-ca71eb1d0153'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.252324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00b0700ba4e432995db0e7f8ff616cf', 'request_id': 'req-009e7a05-524d-47fd-8507-ca71eb1d0153'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.279223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3083665fd23c4ff4acb758314f4d75bf', 'request_id': 'req-a160070b-d9c1-42b6-a8a8-0963c5737856'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.284707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3083665fd23c4ff4acb758314f4d75bf', 'request_id': 'req-a160070b-d9c1-42b6-a8a8-0963c5737856'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.318692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00b0700ba4e432995db0e7f8ff616cf', 'request_id': 'req-009e7a05-524d-47fd-8507-ca71eb1d0153'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.332690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] The token cache is being invalidate because project e00b0700ba4e432995db0e7f8ff616cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:37.332981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.333667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-009e7a05-524d-47fd-8507-ca71eb1d0153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.335345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1002/2005] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:36 2022] DELETE /identity/v3/projects/e00b0700ba4e432995db0e7f8ff616cf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:37.340608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155bb8-0ac0-41b6-8610-32596c94e59d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.340910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155bb8-0ac0-41b6-8610-32596c94e59d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.341212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6155bb8-0ac0-41b6-8610-32596c94e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.360229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c6155bb8-0ac0-41b6-8610-32596c94e59d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:37.361464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c6155bb8-0ac0-41b6-8610-32596c94e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.375814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3083665fd23c4ff4acb758314f4d75bf', 'request_id': 'req-a160070b-d9c1-42b6-a8a8-0963c5737856'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.388586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] The token cache is being invalidate because project 3083665fd23c4ff4acb758314f4d75bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:37.388874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.389557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a160070b-d9c1-42b6-a8a8-0963c5737856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:37.391141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1004/2006] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:37 2022] DELETE /identity/v3/projects/3083665fd23c4ff4acb758314f4d75bf => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:37.395775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ab10-c8e5-4239-96c9-80c6f37a9e39 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.396065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ab10-c8e5-4239-96c9-80c6f37a9e39 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.396351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ab10-c8e5-4239-96c9-80c6f37a9e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.414063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9894ab10-c8e5-4239-96c9-80c6f37a9e39 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:37.415302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9894ab10-c8e5-4239-96c9-80c6f37a9e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.422190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1003/2007] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:37.423791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1005/2008] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:37.429934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.430230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.430532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.430878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.431670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.431992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.450233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:37.450656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:37.451499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.451858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:37.460006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1004/2009] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:37.460155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1006/2010] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:37.464338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.464480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.473400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2903af-4a33-4e90-99a2-5a4de32946ee None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.473543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca57f3e-4471-4e44-afe0-b527eeeaa352 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.478234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.478370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.478961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.479239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.479338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.479509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.479604 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.479800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.480234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:37.480523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:37.480623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.480829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.482165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.482452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.494321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1007/2011] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:37.494991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1005/2012] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:37.498908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.499195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.511347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a4721-c92e-4213-9ede-8476bdd7f4f3 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.512287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7866866-2644-48aa-ac93-3e62456fa6ac admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.517106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.517763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.518050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.518329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.519049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.520762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.520958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.521922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.522429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.522899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.523882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.526796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.629903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1006/2013] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:37.631364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1008/2014] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:37.635063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.635746 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.700190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811070-c1c2-4e73-8e7d-f818ff06ae17 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.701931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2d5dd-9bce-409a-b7ec-0556740cade2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.705102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.705773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.706116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.706506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.706762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.707207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.707602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.707885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.708163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.708843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.709157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.710867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.825138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1009/2015] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:37.826280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.835934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd4bc6-df9a-47fb-b474-1381ffe3aabf admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.841564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.842240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.842525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.842806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.843599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.845401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.854309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1007/2016] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:37 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:37.856338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1010/2017] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:37.860569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.860676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.871332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f099-61ab-4172-9c73-709320079591 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.871475 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533a097-c1ee-472a-9363-27c87fe2256c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.875572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.876285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.876422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.876760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.877111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.877209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.877431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.877749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.878050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.878443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.879675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.880146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.891632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1008/2018] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:37.894974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1011/2019] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:37.895689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.899882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.906913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfda5c-7b4b-4dc4-ac58-c91a93b00f8b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.907555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be66f2c-10c9-4f51-b69c-b8e765ac7886 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.912690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.913432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.913582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.913890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.914240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.914591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.914877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.915155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] PATH_INFO: `/v3/projects/eb1d69b9d09f4becbc18b12f6260840e/users/61aa1986133442e58bbaf98b2f86a1d1/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.915256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.917576 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.930195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1009/2020] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:37.930379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1d69b9d09f4becbc18b12f6260840e, user_id=61aa1986133442e58bbaf98b2f86a1d1, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.934709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:37.938216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874a1a1-87cb-4fa8-9747-9090f42e8e1d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:37.946246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b5dc7-2249-4d68-87a5-cd075d36ca18 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:37.951333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:37.952310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:37.952659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:37.952995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] PATH_INFO: `/v3/projects/3fea3a5000ad4c90ab5592f86534b5c1/users/bd728e8c7e15442aba7adf1657d4b847/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:37.971436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fea3a5000ad4c90ab5592f86534b5c1, user_id=bd728e8c7e15442aba7adf1657d4b847, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:37.974402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858be2-c7cb-46f7-ba88-cb2fe89982ce admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.022592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1012/2021] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:37 2022] PUT /identity/v3/projects/eb1d69b9d09f4becbc18b12f6260840e/users/61aa1986133442e58bbaf98b2f86a1d1/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:38.036121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.036312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.036572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.062375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1010/2022] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:37 2022] PUT /identity/v3/projects/3fea3a5000ad4c90ab5592f86534b5c1/users/bd728e8c7e15442aba7adf1657d4b847/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:38.065338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.065766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.066454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] MFA Rules not processed for user `61aa1986133442e58bbaf98b2f86a1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:38.066651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.067725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:38.084800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:38.086084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:38.149310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1013/2023] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:38.151260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.164026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1011/2024] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:38.175207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.176683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:38.229770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6ea2d-be6e-4000-ad95-97ab1a5a6e59 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.238232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.239049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.239332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.239606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.240303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.241022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf0726-f8ab-4791-9339-df9dd6b151a7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.242803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.246987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.247726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.248076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.248425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.258476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.260902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.271571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1012/2025] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:38.425318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1014/2026] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:38 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:38.429568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.444175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e3ce-aad8-4e1f-963f-38daa194a00f service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.532073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.532865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.533182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.533460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.534325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.536168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.657787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1013/2027] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:38 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:38.661743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.672868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60690fb-4d00-4d1e-844a-c9ae8a2c897f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.678898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.679591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.679970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.680561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.682494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.684026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.711230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1015/2028] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:38.715774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.731139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979c41-63a4-46e2-bb3f-709455bf85b1 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.737181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.738584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.739024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.739351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] PATH_INFO: `/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22/users/3e2795acc7874001ad83e79bcac8192c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.763409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda8bbe0d3e24e0fb32d0184bad18c22, user_id=3e2795acc7874001ad83e79bcac8192c, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.766081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.862391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.862946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1014/2029] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:38 2022] PUT /identity/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22/users/3e2795acc7874001ad83e79bcac8192c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:38.877495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086074-72a6-45b0-a3be-6c361d3f459e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.951738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.953292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.953577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.953855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:38.954656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:38.956290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a225089-1270-45bf-a327-c99a0a8dfa93 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:38.972686 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1016/2030] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:38.978016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:38.992807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5498b6-84a4-4524-9e36-693dc535f997 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:38.998641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:38.999278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:38.999596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:38.999796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] PATH_INFO: `/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22/users/3e2795acc7874001ad83e79bcac8192c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:39.001912 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda8bbe0d3e24e0fb32d0184bad18c22, user_id=3e2795acc7874001ad83e79bcac8192c, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:39.005263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:39.023290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1015/2031] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:38 2022] PUT /identity/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22/users/3e2795acc7874001ad83e79bcac8192c/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:39.034264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:39.035198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:39.036122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:39.070917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] MFA Rules not processed for user `3e2795acc7874001ad83e79bcac8192c`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:39.072151 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:39.171465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1017/2032] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:39.193593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:39.195379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:39.278774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9140a-733f-4254-a19f-fea6c8b65afa admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:39.282658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:39.283345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:39.283593 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:39.283864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:39.294572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:39.296036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b849-9784-4458-ac57-0a7eeafa8466 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:39.306716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1016/2033] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:39.477477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:39.492344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724b8e5-7fa8-45e4-a6df-c541155115f2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:39.514007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:39.515334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:39.515627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:39.515908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:39.581934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:39.583374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:39.593775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1018/2034] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:40.168271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:40.168563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:40.168838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:40.197836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] MFA Rules not processed for user `bd728e8c7e15442aba7adf1657d4b847`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:40.199053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:40.284864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1017/2035] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:40.300291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:40.302832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:40.314627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bce98-9760-44aa-997d-967d40de5081 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:40.318697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:40.319715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:40.319836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:40.320448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:40.330763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:40.332506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e501cd6-e871-4dbe-a9e8-6639839527ec service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:40.353503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1019/2036] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:42.050614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:42.052353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:42.122942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de49c09-b52f-48d1-965c-210a9ff1d9d3 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:42.127493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:42.128424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:42.128708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:42.128987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] PATH_INFO: `/v3/users/a1f0b90b689143e79e005550c41d6484` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:42.130332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f0b90b689143e79e005550c41d6484)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:42.132304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:42.185424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:42.185936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:42.186039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:42.204064 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] MFA Rules not processed for user `bd728e8c7e15442aba7adf1657d4b847`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:42.205155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:42.217080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1020/2037] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:42.453940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f0b90b689143e79e005550c41d6484'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.460709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f0b90b689143e79e005550c41d6484'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.461420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f0b90b689143e79e005550c41d6484'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.553404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:42.555427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:42.562354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f0b90b689143e79e005550c41d6484'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.564402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f0b90b689143e79e005550c41d6484'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.581403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b2c3e-d1e0-4a8c-b2a6-129614d1d5e7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:42.591488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1018/2038] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:42 2022] DELETE /identity/v3/users/a1f0b90b689143e79e005550c41d6484 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:42.606040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:42.608099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:42.608385 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:42.610140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] PATH_INFO: `/v3/users/8a64e3ed20664767b7de772eee23a46f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:42.613915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a64e3ed20664767b7de772eee23a46f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:42.619461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:42.921336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a64e3ed20664767b7de772eee23a46f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.922086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a64e3ed20664767b7de772eee23a46f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.928805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a64e3ed20664767b7de772eee23a46f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:42.938753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:42.940507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.019497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9a0-2955-43dd-98cb-f2d25fec4c93 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.021934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a64e3ed20664767b7de772eee23a46f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.022609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-df3099a1-a592-4ce7-a3b1-0d6fefd3a395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a64e3ed20664767b7de772eee23a46f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.034578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.034798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.036914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.036914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] PATH_INFO: `/v3/projects/7f9f428da01b4b9eb0ca5a5fce438b6b` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.037196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9f428da01b4b9eb0ca5a5fce438b6b)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.042141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.059702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1021/2039] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:42 2022] DELETE /identity/v3/users/8a64e3ed20664767b7de772eee23a46f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:43.063842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.064135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.064703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.085590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:43.087979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.169845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1022/2040] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:43.179572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9f428da01b4b9eb0ca5a5fce438b6b', 'request_id': 'req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.182243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.184827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.188305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9f428da01b4b9eb0ca5a5fce438b6b', 'request_id': 'req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.248467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eac0dc-32c4-45d2-9550-e8c68056898b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.292603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9f428da01b4b9eb0ca5a5fce438b6b', 'request_id': 'req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.295662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.296323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.296605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.296880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.304213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] The token cache is being invalidate because project 7f9f428da01b4b9eb0ca5a5fce438b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:43.304498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.305176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-80a1868c-20e5-4ca1-a05f-f1a2ec3771e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:43.307342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1019/2041] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:42 2022] DELETE /identity/v3/projects/7f9f428da01b4b9eb0ca5a5fce438b6b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:43.312276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.312732 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.313019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.335611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:43.336809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.360258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.361730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddbff9-b3c3-4dde-a12a-9a6c1a10c888 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.372774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1023/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:43.397818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1020/2043] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:43.406676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.406965 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.407339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.425256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:43.426464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.435517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1024/2044] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:43.439903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.450972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d66ab-1d2c-4067-8c66-df9bbfe6752f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.455865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.456534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.456824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.457133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.457865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:43.458174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.459885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.473080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1021/2045] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:43.476320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.486559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4680f-38dd-4283-8d17-d33cf6eaaf42 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.491445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.492178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.492458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.492733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.493499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.506896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.593632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1025/2046] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:43 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:43.607585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.628265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf837e-415c-4bf9-bc6f-f48b07b37998 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.701307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.701997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.703327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.703327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.703327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.705185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.805086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1022/2047] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:43 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:43.806715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.817332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eadbe-c8a2-443b-8cfc-ff520e97d2a4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.824053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.824715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.825003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.825323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.826056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.827712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.843012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1026/2048] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:43.847096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.855866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.858159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:43.861960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714da7dc-f451-4ce5-94d9-9e40072ede79 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.869730 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.870939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.871441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.871814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.873403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bbc66-d063-4cd3-b1d3-c369794e424f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.873863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.876612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.879605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.880834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.880970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.881196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] PATH_INFO: `/v3/projects/0ad66a5e7b064055b3e730033dbfc2ed` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.882489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad66a5e7b064055b3e730033dbfc2ed)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.899342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1023/2049] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:43.905630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:43.910501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:43.942556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8cfa8-9524-403f-9529-2d1397bc2e8f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:43.955449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:43.956533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:43.956649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:43.956891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] PATH_INFO: `/v3/projects/ea3dba69ec7247edbf90aa046e4976fa/users/4829134c464e47ae8e650f7856ef9388/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:43.980859 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3dba69ec7247edbf90aa046e4976fa, user_id=4829134c464e47ae8e650f7856ef9388, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:43.983696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a017-6ea0-4f66-b433-a3c911f3e068 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:44.062392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1024/2050] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:43 2022] PUT /identity/v3/projects/ea3dba69ec7247edbf90aa046e4976fa/users/4829134c464e47ae8e650f7856ef9388/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:44.074244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:44.074535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:44.074818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:44.077206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad66a5e7b064055b3e730033dbfc2ed', 'request_id': 'req-afe8f97d-695c-4eee-8188-a8f84be62059'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.083005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad66a5e7b064055b3e730033dbfc2ed', 'request_id': 'req-afe8f97d-695c-4eee-8188-a8f84be62059'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.103009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] MFA Rules not processed for user `4829134c464e47ae8e650f7856ef9388`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:44.104537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:44.162517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad66a5e7b064055b3e730033dbfc2ed', 'request_id': 'req-afe8f97d-695c-4eee-8188-a8f84be62059'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.177284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] The token cache is being invalidate because project 0ad66a5e7b064055b3e730033dbfc2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:44.177679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.178045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1025/2051] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:44.178593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.184272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1027/2052] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:43 2022] DELETE /identity/v3/projects/0ad66a5e7b064055b3e730033dbfc2ed => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:44.184494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:44.193265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:44.195810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:44.250965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41374b-d9d9-4e5d-9ba4-50a9d460d358 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:44.255655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:44.256529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:44.256814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:44.257116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] PATH_INFO: `/v3/users/50687934720a45768de16c4a14c730ba` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:44.258312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=50687934720a45768de16c4a14c730ba)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:44.261166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:44.274735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8f97d-695c-4eee-8188-a8f84be62059 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:44.280673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:44.281396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:44.281685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:44.281963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:44.283816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:44.294654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:44.296235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:44.304919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1028/2053] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:44.536782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50687934720a45768de16c4a14c730ba'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.543959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50687934720a45768de16c4a14c730ba'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.544620 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50687934720a45768de16c4a14c730ba'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.618373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50687934720a45768de16c4a14c730ba'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.619516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50687934720a45768de16c4a14c730ba'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:44.637119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1026/2054] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:44 2022] DELETE /identity/v3/users/50687934720a45768de16c4a14c730ba => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:45.157496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:45.159137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.174857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:45.176354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.180756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fc2eb-e687-49e3-9e31-330654eaa92e service nova] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:45.256687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:45.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] PATH_INFO: `/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241f1c89abd24fc5a4311675ba7e6b6f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:45.263889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:45.270775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f1ae-e366-43f1-be8b-9de1b37717ae admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:45.277250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:45.278597 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.279030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.279855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] PATH_INFO: `/v3/users/61aa1986133442e58bbaf98b2f86a1d1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.286559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=61aa1986133442e58bbaf98b2f86a1d1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:45.289492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:45.409498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241f1c89abd24fc5a4311675ba7e6b6f', 'request_id': 'req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.414769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241f1c89abd24fc5a4311675ba7e6b6f', 'request_id': 'req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.521374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241f1c89abd24fc5a4311675ba7e6b6f', 'request_id': 'req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.533281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] The token cache is being invalidate because project 241f1c89abd24fc5a4311675ba7e6b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:45.533569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.534206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-cff4a9cb-7d6e-4aa4-a6d3-72547a755861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.535735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1029/2055] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:45 2022] DELETE /identity/v3/projects/241f1c89abd24fc5a4311675ba7e6b6f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:45.540478 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d0da-8879-4cea-90ae-158d45acf213 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.541449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d0da-8879-4cea-90ae-158d45acf213 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.541879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201d0da-8879-4cea-90ae-158d45acf213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.560407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3201d0da-8879-4cea-90ae-158d45acf213 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:45.560602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61aa1986133442e58bbaf98b2f86a1d1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.561718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3201d0da-8879-4cea-90ae-158d45acf213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.567797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61aa1986133442e58bbaf98b2f86a1d1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.568498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61aa1986133442e58bbaf98b2f86a1d1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.622694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1030/2056] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:45.631117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.631400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.631678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.651550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:45.675317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.675317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1031/2057] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:45.675317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:45.679925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdca28-5b17-49e3-b876-c1b3c77c8d40 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:45.685222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:45.685889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.686173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.686449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.687167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:45.687474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:45.689213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:45.701624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1032/2058] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:59:45.711206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:45.721496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789043c3-4895-400e-8c1e-84180d165b21 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:45.726487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:45.727144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.727463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.727776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.728769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:45.730740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:45.732643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61aa1986133442e58bbaf98b2f86a1d1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.733362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8c3fb2ca-5636-417f-87e3-98da347c5a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61aa1986133442e58bbaf98b2f86a1d1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:45.751342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1027/2059] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:45 2022] DELETE /identity/v3/users/61aa1986133442e58bbaf98b2f86a1d1 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:45.762017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.762017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.762017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.884423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:45.884423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.884423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1028/2060] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:45.893548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:45.894943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:45.950384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816072c-e65f-4a17-bd65-bd952b99f705 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:45.953995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:45.954711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:45.954991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:45.955263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:45.964589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:45.966042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:45.975333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1029/2061] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:46.085627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1033/2062] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:45 2022] POST /identity/v3/projects => generated 383 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:46.090679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.092138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:46.106122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51540437-fbfe-4e11-8c8d-614ec270985b service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.163078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.163547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.163829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.164106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.164793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.167926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.271955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1030/2063] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:46 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:46.273894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.284779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355e188-d03c-4f61-a249-711727460d7c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.290589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.292155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.293013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.293621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.294855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.297105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.312396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1034/2064] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:46.318701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.336595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e410c58-8dc9-4a5c-9f06-81070c0faf8d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.344462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.345719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.346341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.347307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.348400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.350478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.370551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1031/2065] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:46.374654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.384977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce3d91-0f3e-44a5-9b07-e3dfb7732b6a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.390697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.396963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.396963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.396963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] PATH_INFO: `/v3/projects/7c314a5ade5e4296a257f0b44f74dd2b/users/8f8ee82e76fe434382adcd244f4cf7ad/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.413458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c314a5ade5e4296a257f0b44f74dd2b, user_id=8f8ee82e76fe434382adcd244f4cf7ad, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.418089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee56e85-871f-4296-837f-9f99b282229c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.508692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.513658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:46.526432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101cb3c-915d-4417-bb63-16032f8fb786 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.539897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.541625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1035/2066] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:46 2022] PUT /identity/v3/projects/7c314a5ade5e4296a257f0b44f74dd2b/users/8f8ee82e76fe434382adcd244f4cf7ad/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:46.541970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.542306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.542583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] PATH_INFO: `/v3/projects/eb1d69b9d09f4becbc18b12f6260840e` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.543850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1d69b9d09f4becbc18b12f6260840e)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.545865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.551513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.551802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.552083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.580769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] MFA Rules not processed for user `8f8ee82e76fe434382adcd244f4cf7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:46.582019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:46.649147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1036/2067] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:46.654083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.675310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1d69b9d09f4becbc18b12f6260840e', 'request_id': 'req-81241652-6469-40ae-822d-247da0e5b9a0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:46.684216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1d69b9d09f4becbc18b12f6260840e', 'request_id': 'req-81241652-6469-40ae-822d-247da0e5b9a0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:46.717667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de236c-8d5d-4b89-afef-9d6e878faa9c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.773286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.773952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.774240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.774514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.775810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.777899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.798997 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1d69b9d09f4becbc18b12f6260840e', 'request_id': 'req-81241652-6469-40ae-822d-247da0e5b9a0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:46.813266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] The token cache is being invalidate because project eb1d69b9d09f4becbc18b12f6260840e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:46.813614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:46.814295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:46.816069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1032/2068] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:46 2022] DELETE /identity/v3/projects/eb1d69b9d09f4becbc18b12f6260840e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:46.819898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.821383 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:46.834190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81241652-6469-40ae-822d-247da0e5b9a0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.839011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.839869 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.840151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.840426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] PATH_INFO: `/v3/users/3e2795acc7874001ad83e79bcac8192c` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.841654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2795acc7874001ad83e79bcac8192c)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.845560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:46.880510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1037/2069] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:46 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:46.884911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:46.886626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:46.957589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2310bf-6b59-4487-b5eb-7227a61b6700 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:46.962521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:46.963334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:46.963802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:46.964179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:46.965140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:46.967196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.043458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2795acc7874001ad83e79bcac8192c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:47.050140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2795acc7874001ad83e79bcac8192c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:47.050821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2795acc7874001ad83e79bcac8192c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:47.104552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1038/2070] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:46 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:47.108087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.117483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ed878-49a8-44f3-b650-3aeea03222ac admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.122849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.123486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.123775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.124056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.124778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.126410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.136926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1039/2071] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:47.141014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.149827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2795acc7874001ad83e79bcac8192c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:47.150491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2795acc7874001ad83e79bcac8192c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:47.150627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f296a67-1503-4a7b-aa61-5bb2519f00f2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.156458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.157413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.157704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.158005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] PATH_INFO: `/v3/projects/dda09e60a52c47519d821c7084b0fdb9/users/74e82dccd3554a8bb51049ee3cbda9a4/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.168442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1033/2072] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:46 2022] DELETE /identity/v3/users/3e2795acc7874001ad83e79bcac8192c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:47.174337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda09e60a52c47519d821c7084b0fdb9, user_id=74e82dccd3554a8bb51049ee3cbda9a4, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.177581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.258817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1040/2073] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:47 2022] PUT /identity/v3/projects/dda09e60a52c47519d821c7084b0fdb9/users/74e82dccd3554a8bb51049ee3cbda9a4/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:47.263763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.265344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:47.332681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8ceb2-1161-45da-968f-824024046881 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.394054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.394781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.395171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.395384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.396138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.403321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8716-d753-4981-b4f2-acb5c97cde56 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.410253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1034/2074] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:47.414554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.427371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc28fec-fbce-4b1c-97b7-df066552e684 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.434309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.435381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.435853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.436140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] PATH_INFO: `/v3/projects/dda09e60a52c47519d821c7084b0fdb9/users/74e82dccd3554a8bb51049ee3cbda9a4/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.438773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda09e60a52c47519d821c7084b0fdb9, user_id=74e82dccd3554a8bb51049ee3cbda9a4, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.442051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.458534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1041/2075] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:47 2022] PUT /identity/v3/projects/dda09e60a52c47519d821c7084b0fdb9/users/74e82dccd3554a8bb51049ee3cbda9a4/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:47.475687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.478397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.478397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.509034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] MFA Rules not processed for user `74e82dccd3554a8bb51049ee3cbda9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:47.511255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:47.628979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1035/2076] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:47.642083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.644048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:47.726612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdbea-b43f-49d5-aba7-24d3a3e78eff admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.730725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.731403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.731694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.731975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.742243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.745336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.756229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1042/2077] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:47.873583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:47.885401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d653e2-19f4-40c0-ba51-4d5d193cce0d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:47.894720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:47.895407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:47.895691 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:47.895969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:47.898637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:47.965329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:47.966878 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3251713-b0c3-45fa-8035-2b6a411fc57f service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:47.977158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1036/2078] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:48.126798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:48.131083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:48.194588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27f33-687b-4bf3-8ee7-69f972a221bb service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:48.200268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:48.201082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.201394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.201675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] PATH_INFO: `/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.202893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda8bbe0d3e24e0fb32d0184bad18c22)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:48.204809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:48.294776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda8bbe0d3e24e0fb32d0184bad18c22', 'request_id': 'req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:48.300187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda8bbe0d3e24e0fb32d0184bad18c22', 'request_id': 'req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:48.398560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda8bbe0d3e24e0fb32d0184bad18c22', 'request_id': 'req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:48.410576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] The token cache is being invalidate because project eda8bbe0d3e24e0fb32d0184bad18c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:48.410863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:48.411496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-772eac13-8bb2-4c1a-bbe4-e3aebc874ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:48.413058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1043/2079] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:48 2022] DELETE /identity/v3/projects/eda8bbe0d3e24e0fb32d0184bad18c22 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:48.418270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.418743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.418849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.436611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:48.437842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:48.503459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1037/2080] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:48.514317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.514916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.514916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.533837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:48.535065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:48.545098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1044/2081] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:48.549481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:48.561094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411afdff-98b9-4a4e-99bb-13c9a57010cf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:48.566232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:48.566927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.567210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.567490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.568217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:48.568521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:48.570151 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:48.583554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1038/2082] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 12:59:48.589028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:48.600671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325eadf-05a6-4985-acb9-5125df705c5c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:48.610459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:48.611299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.611585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.612036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.612747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:48.614723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:48.703225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1045/2083] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:48 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:48.707213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:48.718891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cac90-44cb-49fa-a5f4-5751754933c6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:48.830239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:48.830937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:48.831233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:48.831517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:48.832221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:48.834235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:48.979360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1039/2084] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:48 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:48.983538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:48.994624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85f48-edab-4985-8c26-f1cf2d3c2c31 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:48.999175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:48.999833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.000120 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.000395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.001162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.002765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.014071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1046/2085] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:49.018127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.028971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea81b2-1bbc-4ed4-9427-40a4b3572407 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.033708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.034422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.034648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.034928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.035655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.037289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e201df-c913-423b-aff8-613201c96b09 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.048069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1040/2086] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:49.052735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.063624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520ad09-cd5e-4110-afc9-610be055a482 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.068149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.069020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.069339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.069613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] PATH_INFO: `/v3/projects/c512e34437b34e04afa337fc96efdb68/users/fe2d7a33e1b94f1e80c5027ca5879ad7/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.096409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c512e34437b34e04afa337fc96efdb68, user_id=fe2d7a33e1b94f1e80c5027ca5879ad7, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.107496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.219931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1047/2087] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:49 2022] PUT /identity/v3/projects/c512e34437b34e04afa337fc96efdb68/users/fe2d7a33e1b94f1e80c5027ca5879ad7/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:49.230937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.231250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.231557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.257610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] MFA Rules not processed for user `fe2d7a33e1b94f1e80c5027ca5879ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:49.258799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:49.319644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1041/2088] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:49.325089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.384853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750160ac-e044-4c05-ae5b-5c60e28faf98 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.389919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.390569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.390855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.391133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.391828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.393775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.463435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1048/2089] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:49 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:49.467476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.478768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6cb7-5e2b-40e6-9e1a-a43e7c1b2c4b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.535221 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.535894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.536172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.536445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.537155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.539080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.627505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1042/2090] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:49 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:49.640490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.652990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6011a2-37e4-461b-adfb-2d4427a1024b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.661327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.662006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.662299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.662577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.663315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.664904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.676724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1049/2091] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:49.680718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.693264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dca477-dbdd-4769-9f44-d77709dfc90c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.699052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.699917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.700266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.700618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.701462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.703141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53d5d7-9c8a-4651-917b-c4a8230cbb7a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.718835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1043/2092] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:49.720683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:49.730615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99162c50-a1f8-47e1-8f68-8e05c6a8bd1e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:49.735226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:49.736091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.736377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.736656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] PATH_INFO: `/v3/projects/9c9cbb4f184f4c869cfc0f1b20f3c17f/users/8811b53141484464852fbbe1cfb3c664/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.750658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9cbb4f184f4c869cfc0f1b20f3c17f, user_id=8811b53141484464852fbbe1cfb3c664, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:49.753329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:49.850069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1050/2093] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:49 2022] PUT /identity/v3/projects/9c9cbb4f184f4c869cfc0f1b20f3c17f/users/8811b53141484464852fbbe1cfb3c664/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:49.860412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:49.860700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:49.861031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:49.888482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] MFA Rules not processed for user `8811b53141484464852fbbe1cfb3c664`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:49.889630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:49.952607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1044/2094] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:49.957058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.017761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bd4af-2368-4e31-ae5f-e34d8365a26d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.022535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.023198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.023490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.023842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.024601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.026653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.128804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1051/2095] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:49 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:50.132566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.145024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19cb99-215e-426e-89cc-d167e5153b44 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.218295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.219062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.219410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.220356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.220356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.222306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.298413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1045/2096] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:50 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:50.302669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.318794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b3d17-0615-4b8c-9851-40af4d95f458 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.326976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.328128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.328567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.328942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.330582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.332404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.347665 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1052/2097] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:50.352569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.364064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57066892-4e32-4a83-b4f4-f190fde3025a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.370446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.371399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.371722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.371936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] PATH_INFO: `/v3/projects/467cd163c1724f1cadb562846096c2bf/users/4d6eaaab0eab4699b434c488e58e529a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.398887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467cd163c1724f1cadb562846096c2bf, user_id=4d6eaaab0eab4699b434c488e58e529a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.401805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.510550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1046/2098] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:50 2022] PUT /identity/v3/projects/467cd163c1724f1cadb562846096c2bf/users/4d6eaaab0eab4699b434c488e58e529a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:50.514879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.524873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479f35-e951-40c7-8be8-570953469b08 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.584447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.585154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.585471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.585744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.586470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.588092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ecac-2d1d-432d-ae2e-ba19e0f37e33 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.598144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1053/2099] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:50.602384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.613135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537388c7-9f2d-481d-91b4-b39a3e05e742 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.617800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.619492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.619785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.620058 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] PATH_INFO: `/v3/projects/467cd163c1724f1cadb562846096c2bf/users/4d6eaaab0eab4699b434c488e58e529a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.622244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467cd163c1724f1cadb562846096c2bf, user_id=4d6eaaab0eab4699b434c488e58e529a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.625294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.635578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1047/2100] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:50 2022] PUT /identity/v3/projects/467cd163c1724f1cadb562846096c2bf/users/4d6eaaab0eab4699b434c488e58e529a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:50.647506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9b25-2c84-4396-b7c1-17dd35c5b7d1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.648322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9b25-2c84-4396-b7c1-17dd35c5b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.648602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c9b25-2c84-4396-b7c1-17dd35c5b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.679617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-258c9b25-2c84-4396-b7c1-17dd35c5b7d1 None None] MFA Rules not processed for user `4d6eaaab0eab4699b434c488e58e529a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:50.679617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-258c9b25-2c84-4396-b7c1-17dd35c5b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:50.756416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1054/2101] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:50.768062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:50.770457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:50.845646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3461c-c827-4086-af92-ecb256872173 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:50.849595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:50.850512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:50.850729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:50.851070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:50.876123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:50.877765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:50.889483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1048/2102] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:51.930215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:51.930692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:51.930692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:51.948759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] MFA Rules not processed for user `f2a441ce0941447e91a32a8973d921c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:51.950073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:52.009627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1055/2103] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:52.158886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:52.160844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:52.172546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9252-4822-4727-b4f3-335a45efc7dd service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:52.177089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:52.177748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:52.178031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:52.178302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:52.251098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:52.253610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1c91a-60fd-4f1a-9d35-ed1ae5a4daec service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:52.255010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:52.256748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:52.269905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1049/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:52.341363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0fd1-9955-4e17-9c6a-09393c564ff1 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:52.346577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:52.347455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:52.347741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:52.348180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] PATH_INFO: `/v3/users/8f8ee82e76fe434382adcd244f4cf7ad` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:52.349452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8ee82e76fe434382adcd244f4cf7ad)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:52.351445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:52.600754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8ee82e76fe434382adcd244f4cf7ad'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:52.601445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8ee82e76fe434382adcd244f4cf7ad'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:52.608963 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8ee82e76fe434382adcd244f4cf7ad'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:52.698750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8ee82e76fe434382adcd244f4cf7ad'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:52.699449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8ee82e76fe434382adcd244f4cf7ad'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:52.744772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1056/2105] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:52 2022] DELETE /identity/v3/users/8f8ee82e76fe434382adcd244f4cf7ad => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:52.749876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:52.750449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:52.750996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:52.778266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:52.784943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:52.909931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1050/2106] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:52.933445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:52.934966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:53.079943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a9d13-8ed9-4c60-9cb0-8929bc5da7e4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:53.084053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:53.084818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:53.088204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:53.088204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:53.100849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:53.102505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:53.117110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1057/2107] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:53.580543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:53.582011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:53.595812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13dd66-8a7e-479d-b2d7-d998aee1da1f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:53.600868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:53.602172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:53.602172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:53.605898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] PATH_INFO: `/v3/projects/7c314a5ade5e4296a257f0b44f74dd2b` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:53.605898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c314a5ade5e4296a257f0b44f74dd2b)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:53.605898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:53.756177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c314a5ade5e4296a257f0b44f74dd2b', 'request_id': 'req-a894cd64-dc05-4fa4-913b-0835d2e6f423'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:53.762146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c314a5ade5e4296a257f0b44f74dd2b', 'request_id': 'req-a894cd64-dc05-4fa4-913b-0835d2e6f423'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:53.852645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c314a5ade5e4296a257f0b44f74dd2b', 'request_id': 'req-a894cd64-dc05-4fa4-913b-0835d2e6f423'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:53.864678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] The token cache is being invalidate because project 7c314a5ade5e4296a257f0b44f74dd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:53.864966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:53.865632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:53.867238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1051/2108] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:53 2022] DELETE /identity/v3/projects/7c314a5ade5e4296a257f0b44f74dd2b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:53.871808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:53.882080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8dd54-9ede-47e9-856e-3e58fd34738d service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:53.953419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:53.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:53.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:53.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] PATH_INFO: `/v3/users/74e82dccd3554a8bb51049ee3cbda9a4` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:53.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e82dccd3554a8bb51049ee3cbda9a4)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:53.960730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:54.185334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e82dccd3554a8bb51049ee3cbda9a4'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.187302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e82dccd3554a8bb51049ee3cbda9a4'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.197935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:54.202196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:54.204953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e82dccd3554a8bb51049ee3cbda9a4'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.219155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894cd64-dc05-4fa4-913b-0835d2e6f423 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:54.224776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:54.225851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:54.226267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:54.226640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] PATH_INFO: `/v3/users/4829134c464e47ae8e650f7856ef9388` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:54.229080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4829134c464e47ae8e650f7856ef9388)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:54.231144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:54.365519 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e82dccd3554a8bb51049ee3cbda9a4'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.366450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a015395-b60b-42a2-a361-6845eff62aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e82dccd3554a8bb51049ee3cbda9a4'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.389862 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1058/2109] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:53 2022] DELETE /identity/v3/users/74e82dccd3554a8bb51049ee3cbda9a4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:54.511816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4829134c464e47ae8e650f7856ef9388'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.533243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4829134c464e47ae8e650f7856ef9388'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.534192 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4829134c464e47ae8e650f7856ef9388'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.641474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4829134c464e47ae8e650f7856ef9388'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.642094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4829134c464e47ae8e650f7856ef9388'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:54.659708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1052/2110] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 12:59:54 2022] DELETE /identity/v3/users/4829134c464e47ae8e650f7856ef9388 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:54.664277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:54.664567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:54.664841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:54.685150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:54.686351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:54.769764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1059/2111] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:54.788354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:54.792094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:54.868796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625708e6-ea1a-43f4-9668-8e968a65d1a9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:54.872688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:54.873381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:54.873662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:54.873940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:54.883695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:54.886607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073e59-a6ec-4d6b-b256-28c294ac611c service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:54.898324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1053/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:55.069331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.071224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.087614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a023de-730c-4b02-9470-04b6bbc5a6ab None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.097563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.099724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.100497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.100928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] PATH_INFO: `/v3/projects/dda09e60a52c47519d821c7084b0fdb9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.103734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda09e60a52c47519d821c7084b0fdb9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.126001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.247229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda09e60a52c47519d821c7084b0fdb9', 'request_id': 'req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.252562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda09e60a52c47519d821c7084b0fdb9', 'request_id': 'req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.359224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda09e60a52c47519d821c7084b0fdb9', 'request_id': 'req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.371448 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] The token cache is being invalidate because project dda09e60a52c47519d821c7084b0fdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:55.371740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.372400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6cbb3e22-cb64-42c2-abd1-cf376a76fe2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.373997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1060/2113] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:55 2022] DELETE /identity/v3/projects/dda09e60a52c47519d821c7084b0fdb9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:55.380362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.381004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.381311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.399149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:55.401207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.463342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1054/2114] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:55.470920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.471266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.471550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.490186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:55.491425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.500271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1061/2115] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:55.504677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.515835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0576fc-a873-4a1b-b170-180a6a6a319a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.520422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.521093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.521377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.521650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.522397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:55.522701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.524384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.536497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1055/2116] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:55.541816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.551638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.561771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb97fee-afaf-403e-a098-777e311ecc55 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.562041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.566800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.567523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.567749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.568015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.568724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.569236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f949ef-0c31-485f-a153-81d38721f030 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.570757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.576313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.577675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.578134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.578563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] PATH_INFO: `/v3/projects/ea3dba69ec7247edbf90aa046e4976fa` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.580138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3dba69ec7247edbf90aa046e4976fa)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.582662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.653911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1062/2117] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:55.658090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.704364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3dba69ec7247edbf90aa046e4976fa', 'request_id': 'req-0400d312-bae4-4eb4-a3ed-2871365eb8eb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.718143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3dba69ec7247edbf90aa046e4976fa', 'request_id': 'req-0400d312-bae4-4eb4-a3ed-2871365eb8eb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.754390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b78ed-f7f6-4277-8548-a0a556b77b25 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.787339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3dba69ec7247edbf90aa046e4976fa', 'request_id': 'req-0400d312-bae4-4eb4-a3ed-2871365eb8eb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.815213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] The token cache is being invalidate because project ea3dba69ec7247edbf90aa046e4976fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 12:59:55.819728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.819728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0400d312-bae4-4eb4-a3ed-2871365eb8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 12:59:55.820045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.820799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.822204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.822204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.822964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.825252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.825400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1056/2118] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 12:59:55 2022] DELETE /identity/v3/projects/ea3dba69ec7247edbf90aa046e4976fa => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 12:59:55.832681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbdb2e-6cc1-4f9a-8dc1-3d422b2658ce None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.832976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbdb2e-6cc1-4f9a-8dc1-3d422b2658ce None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.833356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbdb2e-6cc1-4f9a-8dc1-3d422b2658ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.862879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6acbdb2e-6cc1-4f9a-8dc1-3d422b2658ce None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:55.864111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6acbdb2e-6cc1-4f9a-8dc1-3d422b2658ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.873622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1057/2119] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:55.881153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.881662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.882714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.910788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1063/2120] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:55.914205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.914777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:55.916296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.916427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:55.925611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1058/2121] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:55.929412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.934619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414747-ba7f-4163-9628-e1575026b0ea admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.939891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.940648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.940833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.941134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.941865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.943461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.952159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e49b2-38de-4519-94eb-de52b3e17385 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.955366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1064/2122] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:55.958992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.961679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.962589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.963210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.967848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.967848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 12:59:55.967848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.967848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.970006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b8f11-0a0e-4e53-8c2e-9f0e896e555a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:55.974917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:55.975588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:55.975876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:55.976293 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:55.977030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:55.978821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:55.987153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1059/2123] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 12:59:55.991183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:55.994534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1065/2124] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:56.002558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5682-d29f-4776-ab7c-9292e87b9fc0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.005867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.009801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.011045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.011359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.011715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.012587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.015022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.020415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817eb0f-f787-4372-8680-74b0924b1528 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.030929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.032722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.033405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.034468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] PATH_INFO: `/v3/projects/f1ee5963c6d44378ace94ad0ff7152f1/users/1f621fd74b5e4b40968d0eb08306e3ff/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.051308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ee5963c6d44378ace94ad0ff7152f1, user_id=1f621fd74b5e4b40968d0eb08306e3ff, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.054029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5962051-8acd-497f-aad8-3d1a1e2d00e1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.176104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1066/2125] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:56 2022] PUT /identity/v3/projects/f1ee5963c6d44378ace94ad0ff7152f1/users/1f621fd74b5e4b40968d0eb08306e3ff/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:56.181377 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.182136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.182136 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.182659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1060/2126] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 12:59:55 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 12:59:56.186674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.204030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:56.205281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:56.268683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c339547-d45b-4106-9d45-78e2c0449049 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.281770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.282547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.282825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.283246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.283986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.284401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1067/2127] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 12:59:56.289783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.298937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.300812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:56.359246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c25f3-e7b0-4388-947c-6de66da3cbce None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.363023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.363675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.363967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.364249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.374286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.375735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.387021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1068/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 12:59:56.408239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1061/2129] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 12:59:56 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 12:59:56.412373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.424658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50221217-b14b-4be8-a494-748b0072723e service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.431747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.432769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.433085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.433801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.434545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.437477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.447745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1069/2130] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 12:59:56.451716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.461484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da99d-f2b5-4061-adce-9f62be47278c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.466379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.467038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.467324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.469719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.469719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.469962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd92d9-95e7-42fd-a808-69c597fe5c6b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.480612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1062/2131] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 12:59:56.484788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.498229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed658aca-a850-442a-9de4-f7cf4f0dc9dc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.506027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.508454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.508454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.508454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] PATH_INFO: `/v3/projects/d2c4d700158c4ebc97c9882e4ab1394a/users/c07c416bf83a4d53827d20c2bd094aef/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.528260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c4d700158c4ebc97c9882e4ab1394a, user_id=c07c416bf83a4d53827d20c2bd094aef, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.530913 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.633563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1070/2132] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 12:59:56 2022] PUT /identity/v3/projects/d2c4d700158c4ebc97c9882e4ab1394a/users/c07c416bf83a4d53827d20c2bd094aef/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 12:59:56.645648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.645944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.646222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.676324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] MFA Rules not processed for user `c07c416bf83a4d53827d20c2bd094aef`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 12:59:56.677586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:56.757885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1063/2133] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 12:59:56.770747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:56.773418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:56.875998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80e77a-4361-4302-988e-2e06fa21ec82 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:56.882022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:56.882775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:56.883068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:56.883351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:56.892499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:56.894156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:56.904230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1071/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 12:59:57.753437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 12:59:57.754911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:57.825492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02081bd6-d5c7-4d09-8fec-caf66c62ec26 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 12:59:57.829318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 12:59:57.829971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 12:59:57.830258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 12:59:57.830537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 12:59:57.832330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 12:59:57.944156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 12:59:57.945764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44050e4c-b4c4-4cfa-8d0f-fd279d8cdd44 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 12:59:57.956430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1064/2135] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:00.452172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:00.518019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e801b4-900d-4959-b8c0-8cf856bc44ed service nova] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:00.522522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:00.523390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:00.523756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:00.524324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] PATH_INFO: `/v3/users/c07c416bf83a4d53827d20c2bd094aef` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:00.526248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07c416bf83a4d53827d20c2bd094aef)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:00.528353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:00.752643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07c416bf83a4d53827d20c2bd094aef'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:00.753531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07c416bf83a4d53827d20c2bd094aef'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:00.765773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07c416bf83a4d53827d20c2bd094aef'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:00.881725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07c416bf83a4d53827d20c2bd094aef'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:00.882618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07c416bf83a4d53827d20c2bd094aef'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:00.911442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1072/2136] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:00 2022] DELETE /identity/v3/users/c07c416bf83a4d53827d20c2bd094aef => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:00.918313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:00.918820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:00.918922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:00.949781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:00.951262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:01.098652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1065/2137] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:01.108062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:01.108695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:01.205972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1d4f-b766-40de-a8ba-0a5ae4ca22d8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:01.210684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:01.212673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:01.212869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:01.213228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:01.229728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:01.231302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035fcde-b443-48e6-9cd5-14025bfd062c service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:01.242282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1073/2138] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:01.721678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:01.723107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:01.760312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6d3be-95fb-4ca9-aa24-c1d91fea352b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:01.767333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:01.768332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:01.768738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:01.769117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] PATH_INFO: `/v3/projects/d2c4d700158c4ebc97c9882e4ab1394a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:01.770486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c4d700158c4ebc97c9882e4ab1394a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:01.774312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:01.896553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c4d700158c4ebc97c9882e4ab1394a', 'request_id': 'req-c5d22ea9-cf71-4c3a-90fe-74941205b54d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:01.903369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c4d700158c4ebc97c9882e4ab1394a', 'request_id': 'req-c5d22ea9-cf71-4c3a-90fe-74941205b54d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:02.009667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c4d700158c4ebc97c9882e4ab1394a', 'request_id': 'req-c5d22ea9-cf71-4c3a-90fe-74941205b54d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:02.038817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] The token cache is being invalidate because project d2c4d700158c4ebc97c9882e4ab1394a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:02.039121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:02.043506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c5d22ea9-cf71-4c3a-90fe-74941205b54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:02.044312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1066/2139] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:01 2022] DELETE /identity/v3/projects/d2c4d700158c4ebc97c9882e4ab1394a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:02.049221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.050018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.050453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.076511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:02.078081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:02.160574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1074/2140] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:02.170106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.170479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.170825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.210370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:02.211449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:02.235782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1067/2141] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:02.240317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.261104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4cbe-bafd-4a58-834a-aaa649b35ced None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.273499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.274193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.274518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.274796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.275926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:02.276242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.280033 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:02.299685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1075/2142] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:00:02.301894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.320132 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880362-abd9-47f4-962f-7f40a3d3ce9f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.329838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.330479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.330842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.331092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.331831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.333819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:02.438536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1068/2143] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:02 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:02.442880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.459089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12860c3e-fa9b-444e-bd01-7b6fd8dd2f85 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.582904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.583748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.584119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.584459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.585546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.588192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:02.740320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1076/2144] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:02 2022] POST /identity/v3/users => generated 279 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:02.752077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.765007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ed46-dbb9-4c98-904f-05b271211183 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.770295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.771231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.771514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.771798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.772535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.774320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:02.786920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1069/2145] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:02.793441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.803599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8da76e-8b3a-4669-8c39-5c280a1a0ce4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.809220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.809921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.810218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.810598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.811334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.812943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c548da-0d7c-4e01-a736-8bdc22a59edb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:02.828780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1077/2146] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:02.832788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:02.843957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535f1a9-b1b0-4e0f-9248-e8ce2745804c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:02.849001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:02.849980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:02.850197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:02.850474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] PATH_INFO: `/v3/projects/d429a9a51f554ade962ab8285110be16/users/e076d53f7fa241fd80801433f09fdf3e/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:02.866439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d429a9a51f554ade962ab8285110be16, user_id=e076d53f7fa241fd80801433f09fdf3e, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:02.869779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.016253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1070/2147] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:02 2022] PUT /identity/v3/projects/d429a9a51f554ade962ab8285110be16/users/e076d53f7fa241fd80801433f09fdf3e/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:03.029903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.030150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.030433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.072660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] MFA Rules not processed for user `e076d53f7fa241fd80801433f09fdf3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:03.074058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:03.147781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1078/2148] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:03.152994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.225461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206611b-9b1b-4040-bda9-eba9984101c5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.233937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:03.233937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.233937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.233937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.236285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:03.238654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.370390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1071/2149] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/projects => generated 357 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:03.374983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.381245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.385490 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:03.391243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd292c-c5af-408e-9f17-9d2d2d6f30a0 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.481322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767290a8-a908-4def-84f5-69a65d18db87 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.490276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:03.491794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.492294 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.492776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] PATH_INFO: `/v3/users/fe2d7a33e1b94f1e80c5027ca5879ad7` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.495284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2d7a33e1b94f1e80c5027ca5879ad7)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:03.497860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.512367 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:03.513532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.513830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.514263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.523541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:03.536190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4d03-3ba1-4207-9dad-19815e6c4315 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.622878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1079/2150] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:03.624402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.624701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.624983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.659652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] MFA Rules not processed for user `1f621fd74b5e4b40968d0eb08306e3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:03.661355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:03.700647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2d7a33e1b94f1e80c5027ca5879ad7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:03.720224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2d7a33e1b94f1e80c5027ca5879ad7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:03.725716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2d7a33e1b94f1e80c5027ca5879ad7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:03.762266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1080/2151] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:03.763886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.791752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920036cc-3fcc-4321-90ea-bdd6b1b2471a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.797608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:03.798295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.798578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.798858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.799597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:03.801422 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.813355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1081/2152] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:03.814191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.815893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:03.829544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51cfcf-5487-4b58-8169-b760707e8905 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.834740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:03.835412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.835701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.835981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.836680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:03.836788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2d7a33e1b94f1e80c5027ca5879ad7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:03.838061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2d7a33e1b94f1e80c5027ca5879ad7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:03.838807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9716-d909-40c2-9c73-d2fd69f11d8d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:03.864802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1072/2153] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:03 2022] DELETE /identity/v3/users/fe2d7a33e1b94f1e80c5027ca5879ad7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:03.869431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:03.870837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:03.938863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1082/2154] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:03.940306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:03.940625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:03.940933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:03.952683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c01fe3-de7f-42f3-8b12-db8525909789 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:03.964952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:03.966728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:04.021003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.022179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.022703 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.023326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] PATH_INFO: `/v3/projects/5740366fffc2452a81c48b320d953238/users/b9d55b4eb3354ec78125735397a8e5a8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.049513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1083/2155] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:04.053786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.055279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5740366fffc2452a81c48b320d953238, user_id=b9d55b4eb3354ec78125735397a8e5a8, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.056145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:04.059121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.073164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c6b3-7ea9-40d0-97c8-3199285ea6d0 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.080514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.081647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.082020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.082278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.083226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.086322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.185960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1073/2156] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:03 2022] PUT /identity/v3/projects/5740366fffc2452a81c48b320d953238/users/b9d55b4eb3354ec78125735397a8e5a8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:04.186935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.190936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:04.207075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1084/2157] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:04 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:04.208209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.221723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11f04e-c11e-41a3-a70e-79bbda0736f5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.264995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39599e7-0858-45d0-a110-cd79eb22f97b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.286507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.287328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.287714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.288136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.314977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.318521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.318521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.318521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.318521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.318857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.334959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1085/2158] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:04.334959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.344141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f83282-4333-4358-a39f-018c6f635a43 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.351670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.352412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.353172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.353948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.354310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.355941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.372886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1086/2159] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:04.372886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.380943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2f62d-d337-401d-a3f6-d5c1401e324c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.384481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.386235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.389307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.390488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.390795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.391287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] PATH_INFO: `/v3/projects/5740366fffc2452a81c48b320d953238/users/b9d55b4eb3354ec78125735397a8e5a8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.396466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5740366fffc2452a81c48b320d953238, user_id=b9d55b4eb3354ec78125735397a8e5a8, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.398138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1074/2160] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:04.399527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5e078-f9c6-4a15-9038-4c8780886487 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.407358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.425582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1087/2161] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:04 2022] PUT /identity/v3/projects/5740366fffc2452a81c48b320d953238/users/b9d55b4eb3354ec78125735397a8e5a8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:04.428005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.428584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.428717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.431678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509285a-2b0e-42f6-b861-b74f0cd1b187 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.472806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] MFA Rules not processed for user `b9d55b4eb3354ec78125735397a8e5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:04.474413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:04.521696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.522800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.523088 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.523413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] PATH_INFO: `/v3/projects/63375812ccc54a88a4dadbb314c39d74/users/4c5fe25308d34a4091c1d30d120d506e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.546055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63375812ccc54a88a4dadbb314c39d74, user_id=4c5fe25308d34a4091c1d30d120d506e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.548843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.581427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1088/2162] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:04.595582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.597250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:04.663255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1075/2163] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:04 2022] PUT /identity/v3/projects/63375812ccc54a88a4dadbb314c39d74/users/4c5fe25308d34a4091c1d30d120d506e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:04.668986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.707275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc930c44-b20c-4c57-b489-5190144fc547 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.783731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e18abd-d2a4-4f8a-a472-15f31385ff4e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.793516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.794243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.794563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.794979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.795820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.799112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.800799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.801734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.802098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.802473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.839315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1076/2164] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:00:04.840254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:04.861739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46351ab-67e2-4377-a27c-e0921c51c2d0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:04.873915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:04.874824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:04.875118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:04.875400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] PATH_INFO: `/v3/projects/63375812ccc54a88a4dadbb314c39d74/users/4c5fe25308d34a4091c1d30d120d506e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:04.877509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63375812ccc54a88a4dadbb314c39d74, user_id=4c5fe25308d34a4091c1d30d120d506e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.881148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.897552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1077/2165] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:04 2022] PUT /identity/v3/projects/63375812ccc54a88a4dadbb314c39d74/users/4c5fe25308d34a4091c1d30d120d506e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:04.909990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:04.912073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:04.925119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1089/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:04 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:00:05.178378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:05.180016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:05.195647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:05.199011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:05.215419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44041811-d5be-4f04-bc96-faca6c718cdf service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:05.313687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f82222-21c8-48ed-8cec-64dcc241b6e4 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:05.318169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:05.318934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:05.319300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:05.319759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:05.322040 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:05.331565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:05.334615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:05.334996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:05.335608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] PATH_INFO: `/v3/projects/c512e34437b34e04afa337fc96efdb68` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:05.337193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c512e34437b34e04afa337fc96efdb68)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:05.340687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:05.406017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:05.407646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:05.425380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1078/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:05.530074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c512e34437b34e04afa337fc96efdb68', 'request_id': 'req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:05.535570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c512e34437b34e04afa337fc96efdb68', 'request_id': 'req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:05.647414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c512e34437b34e04afa337fc96efdb68', 'request_id': 'req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:05.661875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] The token cache is being invalidate because project c512e34437b34e04afa337fc96efdb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:05.662160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:05.662974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:05.664788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1090/2168] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:05 2022] DELETE /identity/v3/projects/c512e34437b34e04afa337fc96efdb68 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:05.668916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:05.681830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de975c-37a8-4a05-8647-2e933f86f3be service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:05.766018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:05.766643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:05.766928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:05.767231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] PATH_INFO: `/v3/users/8811b53141484464852fbbe1cfb3c664` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:05.768608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8811b53141484464852fbbe1cfb3c664)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:05.770706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:06.026279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8811b53141484464852fbbe1cfb3c664'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:06.035091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8811b53141484464852fbbe1cfb3c664'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:06.036080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8811b53141484464852fbbe1cfb3c664'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:06.130062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8811b53141484464852fbbe1cfb3c664'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:06.130828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8811b53141484464852fbbe1cfb3c664'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:06.154958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1079/2169] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:05 2022] DELETE /identity/v3/users/8811b53141484464852fbbe1cfb3c664 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:06.765694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:06.767510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:06.806065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e2e5-5cb6-49d0-bbab-98a04dee8fd6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:06.955242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:06.956322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:06.957427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:06.957427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] PATH_INFO: `/v3/projects/9c9cbb4f184f4c869cfc0f1b20f3c17f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:06.960094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9cbb4f184f4c869cfc0f1b20f3c17f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:06.963760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:07.130807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9cbb4f184f4c869cfc0f1b20f3c17f', 'request_id': 'req-1551713d-f752-450f-8230-84ac0706dd29'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.138902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9cbb4f184f4c869cfc0f1b20f3c17f', 'request_id': 'req-1551713d-f752-450f-8230-84ac0706dd29'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.247842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9cbb4f184f4c869cfc0f1b20f3c17f', 'request_id': 'req-1551713d-f752-450f-8230-84ac0706dd29'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.264556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] The token cache is being invalidate because project 9c9cbb4f184f4c869cfc0f1b20f3c17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:07.265203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.266273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.268652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1091/2170] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:06 2022] DELETE /identity/v3/projects/9c9cbb4f184f4c869cfc0f1b20f3c17f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:07.272574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:07.276611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:07.300409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e072148-6a69-4001-9309-5e8b845e3cd2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:07.393316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:07.394554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:07.394840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:07.395112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] PATH_INFO: `/v3/users/4d6eaaab0eab4699b434c488e58e529a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:07.396301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6eaaab0eab4699b434c488e58e529a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:07.398500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:07.814041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6eaaab0eab4699b434c488e58e529a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.824311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6eaaab0eab4699b434c488e58e529a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.831168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6eaaab0eab4699b434c488e58e529a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.941708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6eaaab0eab4699b434c488e58e529a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.943711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-fcaf9ae8-ef30-4101-aa02-6079e301e38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6eaaab0eab4699b434c488e58e529a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:07.983375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1080/2171] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:07 2022] DELETE /identity/v3/users/4d6eaaab0eab4699b434c488e58e529a => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:08.748425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:08.753169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:08.768504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551713d-f752-450f-8230-84ac0706dd29 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:08.844707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:08.845677 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:08.845979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:08.848051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] PATH_INFO: `/v3/projects/467cd163c1724f1cadb562846096c2bf` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:08.849734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] RBAC: Authorizing `identity:delete_project(project_id=467cd163c1724f1cadb562846096c2bf)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:08.851752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:09.054164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467cd163c1724f1cadb562846096c2bf', 'request_id': 'req-62ff0572-1158-4df1-8643-a34ad5ef473a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:09.067922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467cd163c1724f1cadb562846096c2bf', 'request_id': 'req-62ff0572-1158-4df1-8643-a34ad5ef473a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:09.153228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467cd163c1724f1cadb562846096c2bf', 'request_id': 'req-62ff0572-1158-4df1-8643-a34ad5ef473a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:09.177048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] The token cache is being invalidate because project 467cd163c1724f1cadb562846096c2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:09.177460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:09.178233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-62ff0572-1158-4df1-8643-a34ad5ef473a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:09.180225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1092/2172] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:08 2022] DELETE /identity/v3/projects/467cd163c1724f1cadb562846096c2bf => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:09.186626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:09.187179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:09.187179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:09.220347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:09.221668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:09.337831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1081/2173] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:09.350614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:09.350909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:09.351188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:09.379376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:09.380619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:09.396792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1093/2174] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:09.404972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:09.417637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a54bc-09f9-4991-88f7-124f08191a53 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:09.438236 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:09.438926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:09.439207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:09.439472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:09.441197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:09.441838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:09.445108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:09.470525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1082/2175] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:00:09.474795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:09.486818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff26b8e-f123-4b13-bfa5-304ddced7812 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:09.495758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:09.496685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:09.497417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:09.498061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:09.498982 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:09.502107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:09.698837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1094/2176] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:09 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:09.703341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:09.715648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99258e5b-1e38-4bd0-b829-260bd35f8855 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:09.810103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:09.810782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:09.811235 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:09.814779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:09.814779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:09.814779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:10.033769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1083/2177] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:09 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:10.037981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:10.110959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7666-3144-40b3-99a4-949453d00323 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:10.119081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:10.120359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:10.120724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:10.121018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:10.121801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:10.123441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:10.154511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1095/2178] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:10.155337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:10.251287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d13ea8-9ca5-4c0a-9b53-82c18f5aaa5b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:10.258100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:10.259039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:10.259665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:10.260045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:10.261086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:10.263161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb4df6-bf35-4f7b-bca6-c2004a28a19f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:10.282712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1084/2179] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:00:10.286105 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:10.303916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5374b-c287-4aa5-96eb-ad253456338e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:10.321793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:10.323560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:10.328015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:10.328015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] PATH_INFO: `/v3/projects/86dc06024f2e4661a1d4562454855453/users/a6e3a84b71b642c381508a0720b930f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:10.370221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dc06024f2e4661a1d4562454855453, user_id=a6e3a84b71b642c381508a0720b930f5, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:10.374780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:10.504782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1096/2180] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:10 2022] PUT /identity/v3/projects/86dc06024f2e4661a1d4562454855453/users/a6e3a84b71b642c381508a0720b930f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:10.522210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:10.523346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:10.523789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:10.570365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] MFA Rules not processed for user `a6e3a84b71b642c381508a0720b930f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:10.571756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:10.712637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1085/2181] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:10.717156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:10.825126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f0c7d-aace-4cd6-b62b-d9cdaf4bf874 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:10.830667 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:10.831670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:10.832412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:10.832875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:10.833826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:10.836775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:10.965576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1097/2182] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:10.969453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:10.986391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4302f-556f-4e84-801f-1467b2cbeb20 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:11.099714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:11.100838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.101311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.101811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.103687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:11.105979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:11.222865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1086/2183] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:10 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:11.229611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:11.244387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468794b0-8a1a-4794-9424-cbac5fb1b24b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:11.252632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:11.253926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.254530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.255692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.256736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:11.260690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:11.283719 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1098/2184] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:11.287865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:11.309377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff84c14-5ec1-431b-aaa2-2b175ee0b845 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:11.314484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:11.315389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.315678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.315952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] PATH_INFO: `/v3/projects/0bf64002d24e4fb996eae2a2879de176/users/9ec436c8b084443f8d39b41252df4dc8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.350213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf64002d24e4fb996eae2a2879de176, user_id=9ec436c8b084443f8d39b41252df4dc8, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:11.354398 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:11.482316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1087/2185] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:11 2022] PUT /identity/v3/projects/0bf64002d24e4fb996eae2a2879de176/users/9ec436c8b084443f8d39b41252df4dc8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:11.490714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:11.509533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22412571-0081-4232-8486-24de34ca7cee admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:11.610227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:11.612366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.612366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.612366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.613303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:11.614944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f95dd-1c2e-4289-8fe9-726f61c8ec5c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:11.644979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:11.652158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1099/2186] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:11.668074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e38e14-e6c4-4a47-b645-8f2c1196e982 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:11.674688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:11.675602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.675887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.676981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] PATH_INFO: `/v3/projects/0bf64002d24e4fb996eae2a2879de176/users/9ec436c8b084443f8d39b41252df4dc8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.682219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf64002d24e4fb996eae2a2879de176, user_id=9ec436c8b084443f8d39b41252df4dc8, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:11.684969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:11.710899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1088/2187] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:11 2022] PUT /identity/v3/projects/0bf64002d24e4fb996eae2a2879de176/users/9ec436c8b084443f8d39b41252df4dc8/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:11.718860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e38c0-e5ee-4743-8e06-c40044f22298 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:11.719255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e38c0-e5ee-4743-8e06-c40044f22298 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:11.719637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e38c0-e5ee-4743-8e06-c40044f22298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:11.761607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b18e38c0-e5ee-4743-8e06-c40044f22298 None None] MFA Rules not processed for user `9ec436c8b084443f8d39b41252df4dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:11.763007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b18e38c0-e5ee-4743-8e06-c40044f22298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:11.926612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1100/2188] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:12.009893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:12.030898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:12.188064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41bcb-27fe-4a6c-8e35-f42ca019a915 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:12.205299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:12.219425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:12.219791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:12.221117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:12.339326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:12.341316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:12.353768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1089/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:13.610445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b154-a38c-4232-8f6d-9360172c7372 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:13.610917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b154-a38c-4232-8f6d-9360172c7372 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:13.611028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b154-a38c-4232-8f6d-9360172c7372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:13.701681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d549b154-a38c-4232-8f6d-9360172c7372 None None] MFA Rules not processed for user `4c5fe25308d34a4091c1d30d120d506e`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:13.703426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d549b154-a38c-4232-8f6d-9360172c7372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:13.796615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1101/2190] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:13.810743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:13.812258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:13.886121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86acd3-7cd3-4fdb-84a3-c10fb0067417 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:13.892032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:13.892708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:13.892987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:13.893291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:13.895190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:13.955334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:13.956953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:13.965778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1090/2191] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:18.317916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cb7b-7b05-4690-8423-9489ab3b913d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:18.318489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cb7b-7b05-4690-8423-9489ab3b913d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:18.318587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90cb7b-7b05-4690-8423-9489ab3b913d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:18.336930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-da90cb7b-7b05-4690-8423-9489ab3b913d None None] MFA Rules not processed for user `1f621fd74b5e4b40968d0eb08306e3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:18.338992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-da90cb7b-7b05-4690-8423-9489ab3b913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:18.352639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1102/2192] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:19.538940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:19.549313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c1f8e-5ec8-49f8-8cb6-498e89c59165 service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:19.558249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:19.559457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:19.559805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:19.560152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:19.569990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:19.571524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2b5d2-042d-4f8d-a4e1-5576f2e94b2b service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:19.582213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1091/2193] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:28.386110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c238fb-c284-4ae6-be48-f30f259048f1 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:28.386634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c238fb-c284-4ae6-be48-f30f259048f1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:28.386634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c238fb-c284-4ae6-be48-f30f259048f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:28.404089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-76c238fb-c284-4ae6-be48-f30f259048f1 None None] MFA Rules not processed for user `f77d9e1f887e4b55ae8e982c00a735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:28.405318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-76c238fb-c284-4ae6-be48-f30f259048f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:28.461586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1103/2194] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:29.816628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:29.817130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:29.817242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:29.834024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] MFA Rules not processed for user `da86fdd1a57d4a319f1158e76079ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:29.835215 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:29.895567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1092/2195] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:31.401581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:31.402065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:31.402179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:31.429382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:31.430643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:31.487279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:31.500020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1104/2196] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:31.550174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:31.550174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:31.567587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a918c9-2fc7-4352-9956-cb70aaf52622 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:31.573653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:31.574671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:31.575017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:31.575296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] PATH_INFO: `/v3/users/a6e3a84b71b642c381508a0720b930f5` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:31.576723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e3a84b71b642c381508a0720b930f5)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:31.578791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:31.625129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ea9b7-b1fe-4a19-840d-8f8b2eecb298 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:31.631298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:31.631960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:31.632278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:31.632555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:31.642340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:31.644027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c4296-267f-4b8e-93fd-30ba23f01574 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:31.652819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1105/2197] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:00:31.840344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e3a84b71b642c381508a0720b930f5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:31.849101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e3a84b71b642c381508a0720b930f5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:31.849882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e3a84b71b642c381508a0720b930f5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:31.993627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e3a84b71b642c381508a0720b930f5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:31.995187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e3a84b71b642c381508a0720b930f5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:32.016136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1093/2198] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:31 2022] DELETE /identity/v3/users/a6e3a84b71b642c381508a0720b930f5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:32.020732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:32.021099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:32.021383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:32.065770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:32.068795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:32.158839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1106/2199] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:32.169897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:32.171318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:32.318194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028123cd-a0b0-4293-8d7a-a6c2d142c260 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:32.323406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:32.324338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:32.325076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:32.325708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:32.362623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:32.366863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:32.379255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1094/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:33.247184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:33.249195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:33.282651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ec11-f2ee-4d96-99c2-903ead25ca1f None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:33.296289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:33.300521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:33.300836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:33.301346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] PATH_INFO: `/v3/projects/86dc06024f2e4661a1d4562454855453` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:33.303269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dc06024f2e4661a1d4562454855453)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:33.305466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:33.457655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dc06024f2e4661a1d4562454855453', 'request_id': 'req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:33.467321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dc06024f2e4661a1d4562454855453', 'request_id': 'req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:33.551658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dc06024f2e4661a1d4562454855453', 'request_id': 'req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:33.573128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] The token cache is being invalidate because project 86dc06024f2e4661a1d4562454855453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:33.573444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:33.578192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:33.581767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1107/2201] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:33 2022] DELETE /identity/v3/projects/86dc06024f2e4661a1d4562454855453 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:33.587613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:33.630502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59755e3-3907-4bde-824b-f73beb21bc5b service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:33.823428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:33.824907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:33.825449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:33.825928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] PATH_INFO: `/v3/users/9ec436c8b084443f8d39b41252df4dc8` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:33.827447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec436c8b084443f8d39b41252df4dc8)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:33.829687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:34.197023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec436c8b084443f8d39b41252df4dc8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:34.215669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec436c8b084443f8d39b41252df4dc8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:34.219167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec436c8b084443f8d39b41252df4dc8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:34.328177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec436c8b084443f8d39b41252df4dc8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:34.328984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec436c8b084443f8d39b41252df4dc8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:34.380183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1095/2202] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:33 2022] DELETE /identity/v3/users/9ec436c8b084443f8d39b41252df4dc8 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:35.092979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:35.095196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:35.141981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff1f29-dfc0-4ab6-9330-4d43f29b9d86 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:35.350042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:35.351185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:35.351722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:35.352200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] PATH_INFO: `/v3/users/e076d53f7fa241fd80801433f09fdf3e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:35.354223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e076d53f7fa241fd80801433f09fdf3e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:35.359955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:35.481761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:35.484688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:35.519698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276aa7d9-43fc-4ff3-9842-530fab31e38b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:35.539336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:35.542991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:35.543455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:35.544559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] PATH_INFO: `/v3/projects/0bf64002d24e4fb996eae2a2879de176` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:35.546262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf64002d24e4fb996eae2a2879de176)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:35.550817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:35.737856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e076d53f7fa241fd80801433f09fdf3e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.740948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e076d53f7fa241fd80801433f09fdf3e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.761648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e076d53f7fa241fd80801433f09fdf3e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.782829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf64002d24e4fb996eae2a2879de176', 'request_id': 'req-91c394bb-1de5-425b-8646-abb591a417bc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.789872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf64002d24e4fb996eae2a2879de176', 'request_id': 'req-91c394bb-1de5-425b-8646-abb591a417bc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.856721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e076d53f7fa241fd80801433f09fdf3e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.858239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1de23a5c-caaf-4eb4-ade9-a8d9f4c3cd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e076d53f7fa241fd80801433f09fdf3e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.935908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf64002d24e4fb996eae2a2879de176', 'request_id': 'req-91c394bb-1de5-425b-8646-abb591a417bc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.936183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1108/2203] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:35 2022] DELETE /identity/v3/users/e076d53f7fa241fd80801433f09fdf3e => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:35.937028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:35.937432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:35.937792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:35.946677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] The token cache is being invalidate because project 0bf64002d24e4fb996eae2a2879de176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:35.947028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.948651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-91c394bb-1de5-425b-8646-abb591a417bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:35.957765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1096/2204] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:35 2022] DELETE /identity/v3/projects/0bf64002d24e4fb996eae2a2879de176 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:35.959630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e703-7327-41eb-a58e-e341102bf9c9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:35.959919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e703-7327-41eb-a58e-e341102bf9c9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:35.960198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124e703-7327-41eb-a58e-e341102bf9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:35.999916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:36.001394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:36.113452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7124e703-7327-41eb-a58e-e341102bf9c9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:36.113452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7124e703-7327-41eb-a58e-e341102bf9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:36.133496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1109/2205] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:36.149640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:36.155020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:36.206983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1097/2206] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:36.215630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:36.216018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:36.216377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:36.237875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:36.239635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:36.290001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1098/2207] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:36.294276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:36.310289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454b3cc-569e-47c3-995b-2da842c33135 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:36.325838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1354c-5410-4451-8139-a0459c20f250 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:36.333768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:36.334780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:36.335273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:36.335748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:36.339809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:36.340742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:36.341071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:36.341339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:36.342109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:36.342418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:36.344042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:36.358341 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:36.360495 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:36.368476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1099/2208] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:00:36.373750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:36.387886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1110/2209] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:36.388803 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45f7f8-e8b9-4d40-a53e-4cd9a8aff0f8 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:36.396307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:36.396638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:36.396978 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:36.397409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:36.398097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:36.406112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:36.671928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1100/2210] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:36 2022] POST /identity/v3/projects => generated 385 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:36.676066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:36.692753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d01ab-8793-41e2-b256-cc9039d0ddb0 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:36.815926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:36.817828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:36.818325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:36.819640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:36.820999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:36.826794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:36.964688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1111/2211] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:36 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:36.969594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:36.998584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11869b84-d12f-464f-874d-dfbcfb4f4b70 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:37.015746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:37.019190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:37.019678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:37.020605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:37.021920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:37.029988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:37.067580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1101/2212] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:37.071208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:37.090326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1cd9b-2004-40b3-a9d8-340d76a36f50 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:37.112540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:37.115396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:37.116142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:37.116839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:37.121108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:37.125638 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2335c-18f2-4440-968a-1fb4785b9e07 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:37.163173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1112/2213] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:37.167792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:37.183491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d3021-a1a5-444c-ace3-05f7933b1a80 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:37.196743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:37.198145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:37.198438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:37.198724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] PATH_INFO: `/v3/projects/809d9f627ed644699d7e04abd6adf86e/users/13601eafc5fa4b0cb6ac3411822e39a9/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:37.261838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] RBAC: Authorizing `identity:create_grant(project_id=809d9f627ed644699d7e04abd6adf86e, user_id=13601eafc5fa4b0cb6ac3411822e39a9, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:37.273031 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:37.391255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1102/2214] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:37 2022] PUT /identity/v3/projects/809d9f627ed644699d7e04abd6adf86e/users/13601eafc5fa4b0cb6ac3411822e39a9/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:37.404211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:37.404777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:37.405247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:37.479415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] MFA Rules not processed for user `13601eafc5fa4b0cb6ac3411822e39a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:37.481006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:37.661169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1113/2215] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:37.667574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:37.670943 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:37.816152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881097-7045-45b8-8c9e-bc6d9d30125a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:37.822371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:37.823032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:37.823426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:37.823930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:37.843407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:37.843407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:37.854029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1103/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:37.965992 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:37.967752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:38.204914 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460bf87-f1eb-409b-8979-2c9c827c2723 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:38.209590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:38.210457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:38.210740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:38.213252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] PATH_INFO: `/v3/projects/d429a9a51f554ade962ab8285110be16` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:38.213252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d429a9a51f554ade962ab8285110be16)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:38.214831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:38.401395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd429a9a51f554ade962ab8285110be16', 'request_id': 'req-479686b4-f826-41f0-90bc-5217ba253983'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:38.440287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd429a9a51f554ade962ab8285110be16', 'request_id': 'req-479686b4-f826-41f0-90bc-5217ba253983'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:38.561208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd429a9a51f554ade962ab8285110be16', 'request_id': 'req-479686b4-f826-41f0-90bc-5217ba253983'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:38.601922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] The token cache is being invalidate because project d429a9a51f554ade962ab8285110be16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:38.602446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:38.606834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:38.614366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1114/2217] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:37 2022] DELETE /identity/v3/projects/d429a9a51f554ade962ab8285110be16 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:38.616737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:38.651047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b215e77-85bc-42c6-bbb3-1654380f66e1 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:38.746882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:38.748212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:38.749260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:38.749613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] PATH_INFO: `/v3/users/b9d55b4eb3354ec78125735397a8e5a8` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:38.751164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d55b4eb3354ec78125735397a8e5a8)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:38.753385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:39.042544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d55b4eb3354ec78125735397a8e5a8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:39.056271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d55b4eb3354ec78125735397a8e5a8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:39.056946 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d55b4eb3354ec78125735397a8e5a8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:39.121714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d55b4eb3354ec78125735397a8e5a8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:39.122677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4853ac8d-2024-4a42-a4b5-9cf5af857c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d55b4eb3354ec78125735397a8e5a8'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:39.186800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1104/2218] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:38 2022] DELETE /identity/v3/users/b9d55b4eb3354ec78125735397a8e5a8 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:39.871600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:39.873103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:39.886356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479686b4-f826-41f0-90bc-5217ba253983 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:39.945925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:39.947353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:39.947810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:39.948090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] PATH_INFO: `/v3/projects/5740366fffc2452a81c48b320d953238` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:39.949326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=5740366fffc2452a81c48b320d953238)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:39.951256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.107303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5740366fffc2452a81c48b320d953238', 'request_id': 'req-c8b08825-5d32-4520-9679-174f1dd517ed'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:40.114331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5740366fffc2452a81c48b320d953238', 'request_id': 'req-c8b08825-5d32-4520-9679-174f1dd517ed'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:40.195929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5740366fffc2452a81c48b320d953238', 'request_id': 'req-c8b08825-5d32-4520-9679-174f1dd517ed'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:40.209555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] The token cache is being invalidate because project 5740366fffc2452a81c48b320d953238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:40.210854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:40.210854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c8b08825-5d32-4520-9679-174f1dd517ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:40.213782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1115/2219] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:39 2022] DELETE /identity/v3/projects/5740366fffc2452a81c48b320d953238 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:40.219190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.219711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.220131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.241635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:40.242866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:40.346289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1105/2220] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:40.355856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.356382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.360436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.383736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:40.385844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:40.399352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1116/2221] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:40.404539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.419140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404295a-f6f0-4f66-898c-852cb94392c8 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.438783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.439467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.439926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.440175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.440919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:40.441263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.442923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.457639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1106/2222] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:00:40.461716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.473473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899cae2-82e9-4b29-a0b8-c78d6c5c7b00 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.479439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.480605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.481287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.481793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.482781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.485540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.581109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1117/2223] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:40 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:40.584071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.600325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866aa45-90e8-4180-a9f9-dfd1d080cfee admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.694207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.695037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.695483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.695590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.696223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.698991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.795989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1107/2224] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:40 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:40.800203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.812951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651739-b876-4e81-9696-fb4ce783c432 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.818111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.818768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.819054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.819330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.820203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.822029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.834319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1118/2225] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:40.839157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.849450 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a142a3-7957-499f-806d-d157cdc50954 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.856179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.856861 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.857199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.857486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.858325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.859957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d73359-d917-4516-a4d4-7e654c1d9838 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.872571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1108/2226] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:00:40.876629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:40.889575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0614ef-4df3-4a59-860a-eea1d0168fcb admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:40.895108 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:40.896098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:40.896389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:40.896854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] PATH_INFO: `/v3/projects/b05f3974638e486a941afd9ed247e1c9/users/c2d0e5a9fa1744d0a9c046de303b08df/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:40.914262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05f3974638e486a941afd9ed247e1c9, user_id=c2d0e5a9fa1744d0a9c046de303b08df, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:40.917843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:40.999601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1119/2227] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:40 2022] PUT /identity/v3/projects/b05f3974638e486a941afd9ed247e1c9/users/c2d0e5a9fa1744d0a9c046de303b08df/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:41.010145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.010552 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.010915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.059459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] MFA Rules not processed for user `c2d0e5a9fa1744d0a9c046de303b08df`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:41.061375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:41.140796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1109/2228] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:41.141711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.211291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea1a1-68fa-4758-aa31-aebff0bfe355 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.216672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.217516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.217921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.218203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.219154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.221089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.340758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1120/2229] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:41 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:41.347659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.358744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2214b86-b4e2-473a-a1dd-c59931a6d539 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.446288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.447903 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.448274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.448556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.449649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.451634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.584023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1110/2230] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:41 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:41.585535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.600401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07849aa-8dc4-4892-926a-bf12baadaff8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.609194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.609901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.610244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.610538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.611303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.612958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.636082 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1121/2231] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:41.639659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.661318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9389d2-dece-45c6-8825-99887744b7bc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.668338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.669486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.669888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.670301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] PATH_INFO: `/v3/projects/ab8ebaf4e2494862bd8202c50a931833/users/fb1667fecc354ee298fd0c3fee019126/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.698894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8ebaf4e2494862bd8202c50a931833, user_id=fb1667fecc354ee298fd0c3fee019126, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.703006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.806540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1111/2232] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:41 2022] PUT /identity/v3/projects/ab8ebaf4e2494862bd8202c50a931833/users/fb1667fecc354ee298fd0c3fee019126/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:41.814804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.831246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e342a-f20c-416d-8769-fb745876742c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.908580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.909353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.909768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.910115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.911114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.913370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a5c26-94e9-49ab-a004-efdfdf287a19 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.928957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1122/2233] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:41.930004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:41.942794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e6d6-6ac3-453e-b603-fbe2837382c4 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:41.948539 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:41.949594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.949897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.950147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] PATH_INFO: `/v3/projects/ab8ebaf4e2494862bd8202c50a931833/users/fb1667fecc354ee298fd0c3fee019126/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:41.952085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8ebaf4e2494862bd8202c50a931833, user_id=fb1667fecc354ee298fd0c3fee019126, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:41.954768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:41.967045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1112/2234] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:41 2022] PUT /identity/v3/projects/ab8ebaf4e2494862bd8202c50a931833/users/fb1667fecc354ee298fd0c3fee019126/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:41.979868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:41.980223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:41.980442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:42.011115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] MFA Rules not processed for user `fb1667fecc354ee298fd0c3fee019126`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:42.012950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:42.125470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1123/2235] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:42.138412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:42.140598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:42.231897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1db4-df40-41cd-90d5-299cf1a0c212 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:42.237663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:42.238614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:42.239057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:42.239486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:42.250795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:42.252528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1dfd4-3171-49d2-96d0-3092c8aa4f7f service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:42.265096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1113/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:42.438130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:42.512179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61c299-3420-4b61-abae-e513d9ed7eb7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:42.518056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:42.519076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:42.519375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:42.519720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] PATH_INFO: `/v3/users/c2d0e5a9fa1744d0a9c046de303b08df` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:42.521444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d0e5a9fa1744d0a9c046de303b08df)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:42.523073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:42.730453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d0e5a9fa1744d0a9c046de303b08df'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:42.731170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d0e5a9fa1744d0a9c046de303b08df'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:42.739502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d0e5a9fa1744d0a9c046de303b08df'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:42.832802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d0e5a9fa1744d0a9c046de303b08df'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:42.833731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d0e5a9fa1744d0a9c046de303b08df'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:42.860256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1124/2237] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:42 2022] DELETE /identity/v3/users/c2d0e5a9fa1744d0a9c046de303b08df => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:42.860585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:42.860585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:42.860585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:42.885327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:42.887240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:43.005706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1114/2238] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:43.033417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:43.035249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:43.141917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5663f-366b-42ad-a7a3-762bc893011c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:43.145692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:43.146348 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:43.146643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:43.146920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:43.181359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:43.183723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:43.200138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1125/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:43.729122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:43.730925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:43.750562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fcf03-1400-4e4e-9f75-6f4c2c6f37fb None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:43.756102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:43.757302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:43.757739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:43.758245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] PATH_INFO: `/v3/projects/b05f3974638e486a941afd9ed247e1c9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:43.759950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05f3974638e486a941afd9ed247e1c9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:43.762214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:43.955805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05f3974638e486a941afd9ed247e1c9', 'request_id': 'req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:43.965310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05f3974638e486a941afd9ed247e1c9', 'request_id': 'req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.058915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05f3974638e486a941afd9ed247e1c9', 'request_id': 'req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.072950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] The token cache is being invalidate because project b05f3974638e486a941afd9ed247e1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:44.073425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.074091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.078133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1115/2240] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:43 2022] DELETE /identity/v3/projects/b05f3974638e486a941afd9ed247e1c9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:44.080053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:44.092945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441aae2-9c9e-488e-94b6-45fe8eb2d16a service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:44.187842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:44.188816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:44.189343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:44.189693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] PATH_INFO: `/v3/users/fb1667fecc354ee298fd0c3fee019126` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:44.191128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1667fecc354ee298fd0c3fee019126)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:44.193450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:44.417355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1667fecc354ee298fd0c3fee019126'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.418030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1667fecc354ee298fd0c3fee019126'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.424830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1667fecc354ee298fd0c3fee019126'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.510305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1667fecc354ee298fd0c3fee019126'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.511019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-241a9fa1-b68b-4675-9cb1-7592a9492a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1667fecc354ee298fd0c3fee019126'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:44.529135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1126/2241] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:44 2022] DELETE /identity/v3/users/fb1667fecc354ee298fd0c3fee019126 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:45.009992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:45.011534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:45.034763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbf609-3486-45ac-a43b-c33cb8a9d5ef admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:45.137767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:45.139116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.139816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.140293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] PATH_INFO: `/v3/projects/ab8ebaf4e2494862bd8202c50a931833` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.141898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8ebaf4e2494862bd8202c50a931833)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:45.144177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:45.287288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8ebaf4e2494862bd8202c50a931833', 'request_id': 'req-9920c8d0-b967-4f3b-9b3b-21c24bf22662'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:45.296759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8ebaf4e2494862bd8202c50a931833', 'request_id': 'req-9920c8d0-b967-4f3b-9b3b-21c24bf22662'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:45.410083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8ebaf4e2494862bd8202c50a931833', 'request_id': 'req-9920c8d0-b967-4f3b-9b3b-21c24bf22662'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:45.423267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] The token cache is being invalidate because project ab8ebaf4e2494862bd8202c50a931833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:45.423558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:45.424216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9920c8d0-b967-4f3b-9b3b-21c24bf22662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:45.425814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1116/2242] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:45 2022] DELETE /identity/v3/projects/ab8ebaf4e2494862bd8202c50a931833 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:45.430690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.431867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.432709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.451600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:45.452909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:45.516085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1127/2243] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:45.523435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.523777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.524248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.546960 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:45.548413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:45.557707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1117/2244] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:45.561983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:45.571450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2af21-23cf-49fd-a400-794dabfeb0db None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:45.576599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:45.577282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.577570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.577848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.578574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:45.578886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:45.580494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:45.592396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1128/2245] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:00:45.596614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:45.605863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3c657-3d76-4d44-9159-de857f8cc129 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:45.610413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:45.611055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.611335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.611607 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.612289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:45.614204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:45.735069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1118/2246] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:45 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:00:45.739593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:45.749481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077658cd-6651-4620-8572-1e6d06923063 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:45.827843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:45.828798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:45.829313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:45.829790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:45.830657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:45.833315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.010444 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1129/2247] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:45 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:46.011763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.024573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93732c9-3854-4793-b5bd-23f43f00dab1 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.041361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.041361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.041802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.042302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.043198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.045141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.060240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1119/2248] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:46.061477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.073262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b8f56-967e-4465-b48f-4628d1fcd7b2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.079175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.080081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.080368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.080696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.081535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.083153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3832-a070-4f9e-8027-8ede525c085b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.094461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1130/2249] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:46.098712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.109174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11137a7-b89b-429e-96f2-2d5a1e2e371f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.126994 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.128152 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.128269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.128493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] PATH_INFO: `/v3/projects/8f5451c3620b428daf78c6714cd6e196/users/66ba3551281d4be59668330a620d85f6/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.155695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5451c3620b428daf78c6714cd6e196, user_id=66ba3551281d4be59668330a620d85f6, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.159760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.262955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1120/2250] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:46 2022] PUT /identity/v3/projects/8f5451c3620b428daf78c6714cd6e196/users/66ba3551281d4be59668330a620d85f6/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:00:46.273669 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.273970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.274470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.334919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] MFA Rules not processed for user `66ba3551281d4be59668330a620d85f6`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:46.334919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:46.405680 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1131/2251] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:46.407798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.535525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48bc89-79c4-4692-9b13-23e4fe6cb2ff admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.550729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.553756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.554122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.554409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.555136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.559018 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b979d-8f33-41a5-8645-e22480ff486f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.716001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.721375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1121/2252] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:46 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:46.729645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58976a-25b2-4e4b-9a7e-d63e992d6cbb None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.780695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.781002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.781310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.803801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.804801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.805391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.805627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:46.806155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.807213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:46.807566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.810580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:46.906126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1122/2253] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:46.924545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.926431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:46.941251 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1132/2254] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:46 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:46.942106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:46.956420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74da181-7569-4135-9a66-6a38e656aadd admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:46.973131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:46.974085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:46.974526 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:46.974985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:46.975874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:46.977692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.000822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1133/2255] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:47.003075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:47.028957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be82c-18c9-4388-86fb-79ca0923909f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:47.036062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:47.037517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.038651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.039002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] PATH_INFO: `/v3/projects/faee0a2037fd40589bd75a148aaee5cd/users/398358a9e22c4f96adde1a2d56502cbd/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.049048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff981e-43a6-4177-bea8-4ab145ead469 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:47.061801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=faee0a2037fd40589bd75a148aaee5cd, user_id=398358a9e22c4f96adde1a2d56502cbd, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:47.066012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.067165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:47.067890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.068885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.068885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.086577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:47.089791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.099855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1123/2256] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:00:47.190900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1134/2257] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:47 2022] PUT /identity/v3/projects/faee0a2037fd40589bd75a148aaee5cd/users/398358a9e22c4f96adde1a2d56502cbd/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:47.196394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:47.207733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c0c0-569f-4b8d-bd43-35893db1a23d service swift] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:47.276446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:47.277262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.277547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.277822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.278543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:47.280134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f3345-6fbe-474b-9737-d78a3cfc8ad5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.291087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1124/2258] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:00:47.296663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:47.308907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184123d7-7702-420e-bb32-f2fe71947f6f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:47.319443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:47.320993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.321406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.322476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] PATH_INFO: `/v3/projects/faee0a2037fd40589bd75a148aaee5cd/users/398358a9e22c4f96adde1a2d56502cbd/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.334693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] RBAC: Authorizing `identity:create_grant(project_id=faee0a2037fd40589bd75a148aaee5cd, user_id=398358a9e22c4f96adde1a2d56502cbd, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:47.334693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.345147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1135/2259] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:47 2022] PUT /identity/v3/projects/faee0a2037fd40589bd75a148aaee5cd/users/398358a9e22c4f96adde1a2d56502cbd/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:47.383942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.384890 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.385550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.469360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] MFA Rules not processed for user `398358a9e22c4f96adde1a2d56502cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:47.472292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:47.611573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1125/2260] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:47.633371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:47.635425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:47.752222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e982703-0415-4369-a6c9-f92d14a2639c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:47.757867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:47.758560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:47.758848 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:47.759230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:47.771459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:47.773552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:47.802799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1136/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:00:48.263769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:48.266357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:48.291544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c852f91-6b93-4f0b-adf7-6cf11b16d450 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:48.314220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:48.314220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:48.317502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:48.317502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:48.480267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:48.484392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815a4d-91bf-4cd2-9742-1cf42f97d1e9 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:48.516486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1126/2262] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:51.923334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:51.925224 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:52.030101 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8e783-5d01-4a89-b738-3e5fa82825f4 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:52.036227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:52.037383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:52.042358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:52.042358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] PATH_INFO: `/v3/users/13601eafc5fa4b0cb6ac3411822e39a9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:52.042358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13601eafc5fa4b0cb6ac3411822e39a9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:52.042358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:52.268454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13601eafc5fa4b0cb6ac3411822e39a9'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:52.269267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13601eafc5fa4b0cb6ac3411822e39a9'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:52.281907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13601eafc5fa4b0cb6ac3411822e39a9'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:52.373474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13601eafc5fa4b0cb6ac3411822e39a9'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:52.373823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13601eafc5fa4b0cb6ac3411822e39a9'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:52.394300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1137/2263] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:00:51 2022] DELETE /identity/v3/users/13601eafc5fa4b0cb6ac3411822e39a9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:52.398745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:52.400476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:52.400991 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:52.423610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:52.424914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:52.517191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1127/2264] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:52.524546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:52.526753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:52.616549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ab361-ff84-4273-a90b-e116b5299cc0 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:52.620837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:52.621673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:52.621969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:52.622242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:52.633439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:52.635487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e52eb6-2b65-45ec-9a49-3446a5c07eaa service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:52.648286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1138/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:00:53.352162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:53.352162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:53.369439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e433ec3-279c-4656-8b97-a1dcf8679ea4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:53.387237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:53.387237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:53.387237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:53.387237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] PATH_INFO: `/v3/projects/809d9f627ed644699d7e04abd6adf86e` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:53.387689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] RBAC: Authorizing `identity:delete_project(project_id=809d9f627ed644699d7e04abd6adf86e)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:53.390047 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:53.598440 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809d9f627ed644699d7e04abd6adf86e', 'request_id': 'req-df10df5e-6eab-4348-96d7-a5c72e74daad'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:53.627205 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809d9f627ed644699d7e04abd6adf86e', 'request_id': 'req-df10df5e-6eab-4348-96d7-a5c72e74daad'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:53.753382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809d9f627ed644699d7e04abd6adf86e', 'request_id': 'req-df10df5e-6eab-4348-96d7-a5c72e74daad'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:53.781986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] The token cache is being invalidate because project 809d9f627ed644699d7e04abd6adf86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:00:53.782979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:53.783988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-df10df5e-6eab-4348-96d7-a5c72e74daad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:00:53.789594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1128/2266] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:00:53 2022] DELETE /identity/v3/projects/809d9f627ed644699d7e04abd6adf86e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:53.794838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:53.795776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:53.796269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:53.834866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:53.838647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:53.985455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1139/2267] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:53.991741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:53.992041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:53.992325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.029491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:54.029933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:54.053549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1129/2268] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:00:54.056704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.072679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b3337-573d-446f-9a10-9d6098e2be67 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.099322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.100577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.101078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.101555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.103494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:00:54.104013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.112240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:54.150244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1140/2269] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:00:54.154796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.171747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99b3b-edb7-45e4-8d27-55d34445cc49 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.176800 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.177665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.178023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.178357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.179124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.181735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:54.323855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1130/2270] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:00:54 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:54.327937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.339659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a8119-cd35-412d-89f5-013ae4f3a1a4 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.422329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.423106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.423439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.423716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.424661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.427633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:54.643971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1141/2271] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:00:54 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:00:54.650938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.705502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ece14-b18f-450c-b077-fb36033c3512 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.721065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.721065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.721065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.721065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.721776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.721776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:54.735992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1131/2272] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:54.740025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.768674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9189a5-dde9-49c1-b842-d7fe547fb4f9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.794474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.794474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.794474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.794474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.795031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.796378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcfc9b-8b08-427c-946b-1e65db683916 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:54.812324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1142/2273] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:00:54.816370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:54.836301 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc949945-ac26-4e9c-bd53-fa74f1b7e2bf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:54.849087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:54.850000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:54.850279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:54.850551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] PATH_INFO: `/v3/projects/25d111f002fe4df2afbc438cc7658c33/users/e6a24932d7894c199f1374b9203c3873/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:54.882101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d111f002fe4df2afbc438cc7658c33, user_id=e6a24932d7894c199f1374b9203c3873, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:54.885436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:55.066066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1132/2274] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:00:54 2022] PUT /identity/v3/projects/25d111f002fe4df2afbc438cc7658c33/users/e6a24932d7894c199f1374b9203c3873/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:00:55.067811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ed97-0837-4941-9f3a-3c105be2861e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:55.068117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ed97-0837-4941-9f3a-3c105be2861e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:55.068396 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2ed97-0837-4941-9f3a-3c105be2861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:55.092897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-93f2ed97-0837-4941-9f3a-3c105be2861e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:00:55.094500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-93f2ed97-0837-4941-9f3a-3c105be2861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:55.206363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1143/2275] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:00:55.220353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:00:55.223708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:00:55.408720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567cefba-e998-40f6-af5e-46b2d4878e45 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:00:55.415967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:00:55.417963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:00:55.420172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:00:55.422670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:00:55.478250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:00:55.483909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:00:55.561476 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1133/2276] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:03.080038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:03.081091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:03.081543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:03.153852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:03.155569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:03.249956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1144/2277] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:03.266473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:03.281892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:03.339507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:03.341585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:03.373358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5a9b-d9fe-44a2-9887-770b21c1bcc7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:03.380793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:03.382934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:03.383437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:03.383903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] PATH_INFO: `/v3/users/66ba3551281d4be59668330a620d85f6` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:03.385394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ba3551281d4be59668330a620d85f6)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:03.387638 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:03.413480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53a5a8-1189-4ab4-a66a-e9bdc519ceba service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:03.423366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:03.424656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:03.425203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:03.427016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:03.437784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:03.439963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2ee5e-e454-46dd-96ee-50eed19e6bfe service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:03.457026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1134/2278] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:01:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:01:03.737502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ba3551281d4be59668330a620d85f6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:03.738267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ba3551281d4be59668330a620d85f6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:03.754921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ba3551281d4be59668330a620d85f6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:03.832498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ba3551281d4be59668330a620d85f6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:03.833252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ba3551281d4be59668330a620d85f6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:03.859779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1145/2279] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:01:03 2022] DELETE /identity/v3/users/66ba3551281d4be59668330a620d85f6 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:03.864661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:03.865323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:03.865715 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:03.891982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:03.894124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:04.015115 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1135/2280] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:04.028011 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:04.029620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:04.109811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf0d1b-ce10-47f1-b753-5bfcaa563db3 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:04.116812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:04.117980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:04.119799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:04.120805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:04.139380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:04.142213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:04.164261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1146/2281] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:05.284777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:05.286592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:05.336367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda192cc-a1df-4b58-8e2e-45a49fd4168e None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:05.349796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:05.350759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:05.351123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:05.351421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] PATH_INFO: `/v3/projects/8f5451c3620b428daf78c6714cd6e196` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:05.353773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5451c3620b428daf78c6714cd6e196)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:05.355740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:05.500444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5451c3620b428daf78c6714cd6e196', 'request_id': 'req-421ca3ce-eee2-489c-8c37-909c7236f095'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:05.510049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5451c3620b428daf78c6714cd6e196', 'request_id': 'req-421ca3ce-eee2-489c-8c37-909c7236f095'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:05.587193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5451c3620b428daf78c6714cd6e196', 'request_id': 'req-421ca3ce-eee2-489c-8c37-909c7236f095'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:05.610103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] The token cache is being invalidate because project 8f5451c3620b428daf78c6714cd6e196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:01:05.610393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:05.611285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-421ca3ce-eee2-489c-8c37-909c7236f095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:05.614262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1136/2282] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:01:05 2022] DELETE /identity/v3/projects/8f5451c3620b428daf78c6714cd6e196 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:05.619155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:05.634137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f7ff8-0bda-4f5b-9fd4-68e39b33f1f2 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:05.772248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:05.773505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:05.774709 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:05.775321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] PATH_INFO: `/v3/users/398358a9e22c4f96adde1a2d56502cbd` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:05.777566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398358a9e22c4f96adde1a2d56502cbd)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:05.779916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:06.132020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398358a9e22c4f96adde1a2d56502cbd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:06.133395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398358a9e22c4f96adde1a2d56502cbd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:06.155134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398358a9e22c4f96adde1a2d56502cbd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:06.251191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398358a9e22c4f96adde1a2d56502cbd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:06.252543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398358a9e22c4f96adde1a2d56502cbd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:06.324957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1147/2283] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:01:05 2022] DELETE /identity/v3/users/398358a9e22c4f96adde1a2d56502cbd => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:06.902003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:06.902603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:06.902603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:06.971928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] MFA Rules not processed for user `e6a24932d7894c199f1374b9203c3873`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:06.973426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:07.166639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1137/2284] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:07.178287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:07.179734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:07.305031 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f898b8-e035-4aa0-a32e-66592e5cd5a7 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:07.326930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:07.327631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:07.327926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:07.328210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:07.328988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:07.335027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:07.454465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1148/2285] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:01:07 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:07.454667 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:07.464736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb1f18-0d72-4c78-af6b-8ac067844a7a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:07.482062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:07.485183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:07.629154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc951d93-c62f-48d7-84ce-57174519b674 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:07.639204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:07.640952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:07.641460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:07.642044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] PATH_INFO: `/v3/projects/faee0a2037fd40589bd75a148aaee5cd` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:07.645140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faee0a2037fd40589bd75a148aaee5cd)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:07.651269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:07.668084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:07.668886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:07.670034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:07.670271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:07.672131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:07.675581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:07.817515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1138/2286] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:01:07 2022] POST /identity/v3/users => generated 296 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:07.819094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:07.820818 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faee0a2037fd40589bd75a148aaee5cd', 'request_id': 'req-98a50de4-c667-44e5-a5b3-55505d3f9bd7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:07.840047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faee0a2037fd40589bd75a148aaee5cd', 'request_id': 'req-98a50de4-c667-44e5-a5b3-55505d3f9bd7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:07.842634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31062918-6397-44d6-8b8b-cfc0999bbcaf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:07.935313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faee0a2037fd40589bd75a148aaee5cd', 'request_id': 'req-98a50de4-c667-44e5-a5b3-55505d3f9bd7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:07.966485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] The token cache is being invalidate because project faee0a2037fd40589bd75a148aaee5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:01:07.966789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:07.977840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-98a50de4-c667-44e5-a5b3-55505d3f9bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:07.979560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1149/2287] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:01:07 2022] DELETE /identity/v3/projects/faee0a2037fd40589bd75a148aaee5cd => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:01:07.985115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd033a5-d3b1-4da8-8b1e-03c9ca0b14d8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:07.986195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd033a5-d3b1-4da8-8b1e-03c9ca0b14d8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:07.986716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd033a5-d3b1-4da8-8b1e-03c9ca0b14d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:07.987064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:07.987752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:07.988036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:07.989229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:07.990275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:07.999070 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.028420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1139/2288] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:08.032635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.042641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:08.044779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2bd033a5-d3b1-4da8-8b1e-03c9ca0b14d8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:08.047276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2bd033a5-d3b1-4da8-8b1e-03c9ca0b14d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:08.086072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1150/2289] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:01:08.093820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.093952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5a602-da15-49da-b354-d9952fea8524 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.094438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.094904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.112534 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.114381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.122175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.122493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] PATH_INFO: `/v3/projects/30f022f76a04441ba58bd6fb91424698/users/f90f6a5ed5904c88aafe98f49fa3756a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.135676 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:08.137234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:08.147110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1151/2290] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:08.152571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.186678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc28e2-cde8-4586-9675-ded5e7142c46 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.187709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f022f76a04441ba58bd6fb91424698, user_id=f90f6a5ed5904c88aafe98f49fa3756a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.191836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.194964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.196564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.197123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.197749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.198714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:01:08.200140 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.202289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.217959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1152/2291] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:01:08.230192 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.256139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb1443-1c3e-4031-98c6-182670bb1898 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.263276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.274471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.274914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1140/2292] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:01:08 2022] PUT /identity/v3/projects/30f022f76a04441ba58bd6fb91424698/users/f90f6a5ed5904c88aafe98f49fa3756a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:08.275230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.275761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.276698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.279124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.279437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.420709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd9ad-3bf9-46ba-bcdc-1cb0a05efb8c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.426677 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.427673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.428225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.428693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.429663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.432220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.445975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1153/2293] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:01:08 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:08.447440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.447656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1141/2294] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:08.453054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.472822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6b857-4ffe-449b-95d1-e38538ae18bb admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.537228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a223098-3e22-4df3-beb8-aa11759131f2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.545150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.545944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.546315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.546660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.547423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.549951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.597258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.599075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.599753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.600233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] PATH_INFO: `/v3/projects/30f022f76a04441ba58bd6fb91424698/users/f90f6a5ed5904c88aafe98f49fa3756a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.602888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f022f76a04441ba58bd6fb91424698, user_id=f90f6a5ed5904c88aafe98f49fa3756a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.606126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.623917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1142/2295] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:01:08 2022] PUT /identity/v3/projects/30f022f76a04441ba58bd6fb91424698/users/f90f6a5ed5904c88aafe98f49fa3756a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:08.664241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1154/2296] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:01:08 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:08.671589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.818842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f53bc9-ff8b-4ff9-9bb0-812a545caa34 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.826258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.827410 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.828447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.829074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.830066 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.832097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.854876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1143/2297] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:08.859518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.878103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6db83-7805-4a15-a02f-379fa336c755 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.907132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.908240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.908730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.909693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.910810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:08.918319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9f28e-0e8b-491a-9b62-62776547bff7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:08.951811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1155/2298] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:08.955819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:08.969009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98337f-a7fb-4e75-8d37-67db4326626a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:08.975184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:08.977853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:08.978376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:08.978857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] PATH_INFO: `/v3/projects/d24d592ad2e644b396f7e0a55deb51a7/users/c2301652082e4e61952b63dd65f83d91/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:08.997498 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24d592ad2e644b396f7e0a55deb51a7, user_id=c2301652082e4e61952b63dd65f83d91, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:09.000526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:09.083736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1144/2299] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:01:08 2022] PUT /identity/v3/projects/d24d592ad2e644b396f7e0a55deb51a7/users/c2301652082e4e61952b63dd65f83d91/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:09.094744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:09.095038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:09.095325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:09.126590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] MFA Rules not processed for user `c2301652082e4e61952b63dd65f83d91`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:09.128037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:09.214582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1156/2300] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:09.232554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:09.234920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:09.368927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ff7e-6243-48de-82c6-cb5cd276bc9b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:09.376327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:09.377128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:09.377500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:09.378197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:09.389302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:09.391487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:09.436799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1145/2301] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:09.573071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:09.574504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:09.778981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358806e-57ae-40cd-a9f5-be31d83a86af None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:09.784193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:09.785919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:09.785919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:09.786342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] PATH_INFO: `/v3/users/f2a441ce0941447e91a32a8973d921c6` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:09.787975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a441ce0941447e91a32a8973d921c6)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:09.790837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:10.116257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a441ce0941447e91a32a8973d921c6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:10.119179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a441ce0941447e91a32a8973d921c6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:10.129900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a441ce0941447e91a32a8973d921c6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:10.248152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a441ce0941447e91a32a8973d921c6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:10.248152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce6cc178-5700-47ea-9e7a-1365f1ecfd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a441ce0941447e91a32a8973d921c6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:10.269261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1157/2302] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:01:09 2022] DELETE /identity/v3/users/f2a441ce0941447e91a32a8973d921c6 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:10.627631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:10.641462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e50fa-b6e1-494e-89cc-2eeb2a8ae171 service glance] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:10.816582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:10.822153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:10.822438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:10.822734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] PATH_INFO: `/v3/projects/548689fd30d64c928e5f6c883afc09a2` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:10.826295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] RBAC: Authorizing `identity:delete_project(project_id=548689fd30d64c928e5f6c883afc09a2)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:10.828833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:11.099634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548689fd30d64c928e5f6c883afc09a2', 'request_id': 'req-f7477cab-7ffa-4ce8-992b-55bcaa67772e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:11.137441 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548689fd30d64c928e5f6c883afc09a2', 'request_id': 'req-f7477cab-7ffa-4ce8-992b-55bcaa67772e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:11.237418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548689fd30d64c928e5f6c883afc09a2', 'request_id': 'req-f7477cab-7ffa-4ce8-992b-55bcaa67772e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:11.259466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] The token cache is being invalidate because project 548689fd30d64c928e5f6c883afc09a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:01:11.260462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:11.261430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f7477cab-7ffa-4ce8-992b-55bcaa67772e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:11.267579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1146/2303] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:01:10 2022] DELETE /identity/v3/projects/548689fd30d64c928e5f6c883afc09a2 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:11.268987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:11.269705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:11.269705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:11.307859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:11.310124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:11.480802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:11.480977 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:11.481855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:11.497738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1158/2304] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:01:11.512795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:11.514304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:11.541992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1147/2305] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:11.546620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:11.563305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805671-a124-44e2-8a1a-e89b526351fa None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:11.580001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:11.581174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:11.581762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:11.582352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:11.583419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:01:11.583907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:11.585770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:11.622039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1159/2306] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:01:11.623190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:11.635989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0f3d8-3ec1-46c5-9c56-eb3ccebe7522 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:11.659567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:11.660328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:11.660550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:11.672785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:11.672785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:11.672785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:11.790852 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1148/2307] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:01:11 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:01:11.794685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:11.820574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a02840-7320-4a4e-a120-3f5119c78c9d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:12.011138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:12.012215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:12.012215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:12.012483 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:12.013211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:12.028200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:12.247159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1160/2308] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:01:11 2022] POST /identity/v3/users => generated 285 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:12.251264 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:12.270145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd70500-64d4-49b3-8d25-9d881d56cd0d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:12.283466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:12.284186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:12.284471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:12.284751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:12.285576 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:12.287249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:12.314150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1149/2309] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:12.315121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:12.332957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eca7b0-0159-47b4-985e-e40d3f486f47 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:12.357193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:12.361280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:12.361840 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:12.362303 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:12.363687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:12.371423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d2b1-a6c4-40b6-971c-ee3ae2d6df1c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:12.386215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1161/2310] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:01:12.390761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:12.405443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f825c50-581e-40c7-b3b2-80f97543e04f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:12.415853 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:12.418499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:12.419020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:12.419591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] PATH_INFO: `/v3/projects/07f177ebff5941cfb6b057bbf618b319/users/6725eba22d1047abbcaf5866b3f5bdcd/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:12.501343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f177ebff5941cfb6b057bbf618b319, user_id=6725eba22d1047abbcaf5866b3f5bdcd, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:12.505781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:12.593967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1150/2311] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:01:12 2022] PUT /identity/v3/projects/07f177ebff5941cfb6b057bbf618b319/users/6725eba22d1047abbcaf5866b3f5bdcd/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:01:12.603855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e521-7215-4e56-9e36-26d1b4b88faa None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:12.604530 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e521-7215-4e56-9e36-26d1b4b88faa None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:12.604958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e521-7215-4e56-9e36-26d1b4b88faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:12.694197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9087e521-7215-4e56-9e36-26d1b4b88faa None None] MFA Rules not processed for user `6725eba22d1047abbcaf5866b3f5bdcd`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:12.697978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9087e521-7215-4e56-9e36-26d1b4b88faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:12.881346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1162/2312] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:12.896399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:12.904332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:13.104750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a2dd-169f-468d-9c03-80b07932cbe0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:13.108663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:13.109773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:13.109773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:13.110083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:13.122766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:13.124817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c64baf-1262-436c-81af-6e55b67eee79 service glance] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:13.138234 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1151/2313] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:15.898039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622872-8114-4fa1-9a58-f079a5d5dbe1 None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:15.898856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622872-8114-4fa1-9a58-f079a5d5dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:15.899552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82622872-8114-4fa1-9a58-f079a5d5dbe1 None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:15.907760 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1163/2314] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:01:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:01:15.920431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:15.920947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:15.920947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:16.050218 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:16.052061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:16.193942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1152/2315] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:17.810321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:17.810788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:17.810909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:17.841903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] MFA Rules not processed for user `f90f6a5ed5904c88aafe98f49fa3756a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:17.843857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:17.917340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1164/2316] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:17.931828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:17.933326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:17.953140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31906395-4dac-4c55-97bd-c051113ce62d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:17.958909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:17.959579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:17.959863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:17.960141 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:17.962256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:18.032710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:18.034426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e857-126b-4b64-b2e1-9d47f702b8e3 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:18.045246 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1153/2317] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:27.171615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:27.172994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:27.185858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36820d3b-a07e-463e-83c7-a986a51fb3a8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:27.196402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:27.197288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.197635 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.197917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.208878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:27.210485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401283b-6bb7-4535-bc7c-07cffaf136b0 service glance] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:27.223774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1165/2318] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:27.450584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.451130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.451130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.452533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1154/2319] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:01:27.457730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e6b0-ee58-4801-a083-6493991a41c8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.458026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e6b0-ee58-4801-a083-6493991a41c8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.458312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e6b0-ee58-4801-a083-6493991a41c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.476030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d999e6b0-ee58-4801-a083-6493991a41c8 None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:27.477276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d999e6b0-ee58-4801-a083-6493991a41c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:27.528786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1166/2320] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:27.540832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:27.542577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:27.556044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0984f-5894-475b-9498-b5d27f1dd27b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:27.559655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:27.561480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.561480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.561480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.568314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:27.569745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a477e-31f6-4062-bc7c-4a42debe1194 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:27.579171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1155/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:27.666832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.667122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.667426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.668941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1167/2322] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:01:27.674248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566203-ba9b-436c-b3bb-9d6c875d5697 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.674541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566203-ba9b-436c-b3bb-9d6c875d5697 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.674824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15566203-ba9b-436c-b3bb-9d6c875d5697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.693512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-15566203-ba9b-436c-b3bb-9d6c875d5697 None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:27.696544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-15566203-ba9b-436c-b3bb-9d6c875d5697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:27.704094 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1156/2323] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:27.715328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:27.717156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:27.731179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59482eb1-781b-44a0-9f9c-d99d146af38d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:27.734867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:27.735502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:27.735785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:27.736058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:27.746309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:27.747750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:27.761060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1168/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:30.878888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:30.879453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:30.879453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:30.912007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] MFA Rules not processed for user `bd728e8c7e15442aba7adf1657d4b847`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:30.915828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:30.975355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1157/2325] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:32.076662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:32.085586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce8189-7591-4c83-a878-723627647f07 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:32.089837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:32.090449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:32.090736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:32.091015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:32.092797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:32.156548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:32.158072 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46e3e-9602-4b77-87eb-6950a360bfde service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:32.168501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1169/2326] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:33.145676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:33.147252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:33.249030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b81fec-7699-467f-8b77-0a4e4ea9dcbc None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:33.254187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:33.254840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:33.255122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:33.255396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:33.258864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:33.277834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:33.279458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:33.290305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1158/2327] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:35.770231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:35.770716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:35.770809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:35.790701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:35.791942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:35.863411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1170/2328] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:35.887565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:35.889026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:35.983435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087e01f-e632-45ca-8835-65bb0349e41e service placement] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:35.990217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:35.991102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:35.991393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:35.991672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:36.001821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:36.003612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327fd18-bc67-4fbf-9eb1-b4f8f7192d19 service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:36.014232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1159/2329] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:01:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:01:41.817333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:41.819836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:41.911946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defb0ed-c00c-4b1b-8d37-c55491f4b900 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:41.918041 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:41.919304 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:41.920007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:41.920506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] PATH_INFO: `/v3/users/c2301652082e4e61952b63dd65f83d91` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:41.922168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2301652082e4e61952b63dd65f83d91)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:41.924449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:42.234973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2301652082e4e61952b63dd65f83d91'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:42.235578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2301652082e4e61952b63dd65f83d91'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:42.243476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2301652082e4e61952b63dd65f83d91'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:42.313129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2301652082e4e61952b63dd65f83d91'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:42.314227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2301652082e4e61952b63dd65f83d91'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:42.342092 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1171/2330] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:01:41 2022] DELETE /identity/v3/users/c2301652082e4e61952b63dd65f83d91 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:42.346717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:42.347239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:42.347332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:42.371209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:42.372489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:42.433900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1160/2331] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:01:42.443567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:42.444980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:42.512695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332463ee-9c8c-47c2-b974-921efa9af7b6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:42.518127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:42.518805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:42.519088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:42.519510 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:42.530457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:42.531925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c0e9b-ed80-4daa-b5c9-5daa584e7536 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:42.543176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1172/2332] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:01:42.942504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:42.943928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:42.958805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daf3ef-7dcc-414e-a124-21fafaf5e408 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:42.964571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:42.966749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:42.966749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:42.966749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] PATH_INFO: `/v3/projects/d24d592ad2e644b396f7e0a55deb51a7` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:42.967528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24d592ad2e644b396f7e0a55deb51a7)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:42.969519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.072363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24d592ad2e644b396f7e0a55deb51a7', 'request_id': 'req-515c1cf1-656d-47ee-be5b-65062dbc3a1a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:43.078016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24d592ad2e644b396f7e0a55deb51a7', 'request_id': 'req-515c1cf1-656d-47ee-be5b-65062dbc3a1a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:43.195989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24d592ad2e644b396f7e0a55deb51a7', 'request_id': 'req-515c1cf1-656d-47ee-be5b-65062dbc3a1a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:43.208256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] The token cache is being invalidate because project d24d592ad2e644b396f7e0a55deb51a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:01:43.208821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:43.209759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-515c1cf1-656d-47ee-be5b-65062dbc3a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:01:43.214898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1161/2333] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:01:42 2022] DELETE /identity/v3/projects/d24d592ad2e644b396f7e0a55deb51a7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:43.218678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.219218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.219382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.236996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:43.238239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:43.318976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.319926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.321743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.325089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1173/2334] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:43.342164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:43.343381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:43.355285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1162/2335] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:43.359256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.370627 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f119d-b0f5-421f-9b40-c4fea2ef2390 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.375307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.375973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.376261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.376539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.377299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:01:43.377609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.379272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.392633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1174/2336] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:01:43.396942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.406223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947e39-e1a9-4101-88e0-6ae6c3bfb513 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.411254 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.412011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.412229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.412459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.413209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.415478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.537082 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1163/2337] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:01:43 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:43.543682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.554553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df40fd4-fc3b-4013-a68d-d4b776ef546e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.626164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.626763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.627049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.627327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.628025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.630063 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.743487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1175/2338] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:01:43 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:01:43.747692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.758142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39674e-3a80-4792-a279-0a37d1a1e1c7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.762755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.763416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.763696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.763969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.764689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.766590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.778811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1164/2339] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:43.783317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.798727 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad61c79-8303-4bb7-96d3-fd9d627ecd5f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.811274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.811984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.812691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.812983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.814081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.815952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6cab6-6456-4df0-a3cc-4ca6cbdc1d9b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.829507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1176/2340] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:01:43.833907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:43.845106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf30d-4443-45ec-bfa0-e08108308720 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:43.849952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:43.850845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:43.851153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:43.851557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] PATH_INFO: `/v3/projects/3311b6ca8aab4b9a879be0071aff9916/users/7bb6aa5b0c0049378ce0735da0621974/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:43.867775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3311b6ca8aab4b9a879be0071aff9916, user_id=7bb6aa5b0c0049378ce0735da0621974, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:43.873381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:43.999923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1165/2341] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:01:43 2022] PUT /identity/v3/projects/3311b6ca8aab4b9a879be0071aff9916/users/7bb6aa5b0c0049378ce0735da0621974/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:01:44.010524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6df45-6c66-4fbd-af2d-403e32cf8773 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:44.010896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6df45-6c66-4fbd-af2d-403e32cf8773 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:44.011167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6df45-6c66-4fbd-af2d-403e32cf8773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:44.048271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-21b6df45-6c66-4fbd-af2d-403e32cf8773 None None] MFA Rules not processed for user `7bb6aa5b0c0049378ce0735da0621974`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:44.049581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-21b6df45-6c66-4fbd-af2d-403e32cf8773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:44.115910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1177/2342] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:01:44.128127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:01:44.129826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:44.186407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1352e1-66e1-4de8-a4f6-654e55a7f15c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:01:44.190025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:01:44.190668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:44.190948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:44.191223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:44.199735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:01:44.200769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfd48f-d989-4945-a2db-7be0b75d144d service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:01:44.209786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1166/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:01:59.090967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:01:59.091514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:01:59.091619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:01:59.109518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] MFA Rules not processed for user `e6a24932d7894c199f1374b9203c3873`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:01:59.113268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:01:59.165966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1178/2344] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:06.908411 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:06.908913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:06.908913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:06.944099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:06.946778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:07.055099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1167/2345] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:02:07.073203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:07.075233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:07.147046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74a4c5-0cce-4610-a843-5f62903ea96e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:07.153393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:07.154131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:07.154492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:07.154780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:07.164970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:07.166720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba5148-243e-41ee-a670-061b5370a763 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:07.175369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1179/2346] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:02:20.741781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:20.806165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482d2c-cf6c-428f-aa02-59e26405c7a0 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:20.810948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:20.811862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:20.812142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:20.812418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] PATH_INFO: `/v3/users/7bb6aa5b0c0049378ce0735da0621974` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:20.813649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb6aa5b0c0049378ce0735da0621974)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:20.815639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:21.020455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb6aa5b0c0049378ce0735da0621974'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.027967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb6aa5b0c0049378ce0735da0621974'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.028692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb6aa5b0c0049378ce0735da0621974'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.143480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb6aa5b0c0049378ce0735da0621974'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.146797 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb6aa5b0c0049378ce0735da0621974'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.165758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1168/2347] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:02:20 2022] DELETE /identity/v3/users/7bb6aa5b0c0049378ce0735da0621974 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:21.171514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:21.172049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:21.172154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:21.190280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:21.191499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:21.254611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1180/2348] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:21.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:21.281632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:21.331625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f59d02-8778-4d4b-b9f6-ea4efd799e43 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:21.335765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:21.336401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:21.336683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:21.336961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:21.345936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:21.347372 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:21.357224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1169/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:21.563387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:21.564837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:21.579261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159edd26-56fe-49e6-a578-5118cfb52426 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:21.584339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:21.585357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:21.585646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:21.585926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] PATH_INFO: `/v3/users/6725eba22d1047abbcaf5866b3f5bdcd` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:21.588054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6725eba22d1047abbcaf5866b3f5bdcd)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:21.590397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:21.759765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:21.761195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:21.775560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4777c-dacf-4046-868f-6213cc8322a6 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:21.785231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:21.786064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:21.786352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:21.786664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] PATH_INFO: `/v3/projects/3311b6ca8aab4b9a879be0071aff9916` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:21.787969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3311b6ca8aab4b9a879be0071aff9916)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:21.790809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:21.796430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6725eba22d1047abbcaf5866b3f5bdcd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.797159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6725eba22d1047abbcaf5866b3f5bdcd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.805948 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6725eba22d1047abbcaf5866b3f5bdcd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.894920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6725eba22d1047abbcaf5866b3f5bdcd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.895535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-886ee7f8-f51b-4dcb-bc94-83848c585376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6725eba22d1047abbcaf5866b3f5bdcd'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.914579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1181/2350] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:02:21 2022] DELETE /identity/v3/users/6725eba22d1047abbcaf5866b3f5bdcd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:21.918958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:21.919253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:21.919535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:21.940022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:21.945325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:21.945444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3311b6ca8aab4b9a879be0071aff9916', 'request_id': 'req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.949529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3311b6ca8aab4b9a879be0071aff9916', 'request_id': 'req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:21.999986 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1182/2351] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:02:22.004105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3311b6ca8aab4b9a879be0071aff9916', 'request_id': 'req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.014067 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:22.016238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:22.019356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] The token cache is being invalidate because project 3311b6ca8aab4b9a879be0071aff9916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:02:22.022848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.022848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.022848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1170/2352] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:02:21 2022] DELETE /identity/v3/projects/3311b6ca8aab4b9a879be0071aff9916 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:02:22.099442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b76e1-cdcd-4344-84ab-72d9c90c52da None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:22.105663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:22.106679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:22.107125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:22.107559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:22.110280 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:22.129754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:22.132328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e7a43-7b47-4f84-bc9e-b649fc77f917 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:22.148666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1183/2353] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:22.633857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:22.635268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:22.648782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4c2cb-beec-4fa8-9ea4-44461c827fb4 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:22.654054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:22.654925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:22.655202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:22.655480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] PATH_INFO: `/v3/projects/07f177ebff5941cfb6b057bbf618b319` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:22.656671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f177ebff5941cfb6b057bbf618b319)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:22.658829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:22.767799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f177ebff5941cfb6b057bbf618b319', 'request_id': 'req-dee29b1e-44aa-439a-95a8-802638c5da6e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.773105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f177ebff5941cfb6b057bbf618b319', 'request_id': 'req-dee29b1e-44aa-439a-95a8-802638c5da6e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.846766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f177ebff5941cfb6b057bbf618b319', 'request_id': 'req-dee29b1e-44aa-439a-95a8-802638c5da6e'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.857770 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] The token cache is being invalidate because project 07f177ebff5941cfb6b057bbf618b319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:02:22.858057 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.858683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-dee29b1e-44aa-439a-95a8-802638c5da6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:22.860228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1171/2354] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:02:22 2022] DELETE /identity/v3/projects/07f177ebff5941cfb6b057bbf618b319 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:22.865263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:22.865733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:22.865826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:22.884670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:22.885837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:22.943201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1184/2355] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:22.952621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:22.952913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:22.953228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:22.971681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:22.972874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:22.980680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1172/2356] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:22.984837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:22.994423 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c672fd-d281-4990-a6a0-902c1830189d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:22.998941 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:22.999592 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:22.999878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.000159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.000923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:02:23.001283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.002896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.014888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1185/2357] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:02:23.019367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.029127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec00c7-4491-4728-8057-e76f2ed6bec1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.033710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.034353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.034643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.034917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.035605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.037541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.127478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1173/2358] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:02:23 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:02:23.128763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.139374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902c5bb-2c24-4378-b014-8869001d2d84 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.193496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.194661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.194942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.195217 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.195908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.197928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.278697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1186/2359] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:02:23 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:02:23.282751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.292976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694b199-2601-4db5-86b6-9508814e5728 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.297611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.298258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.298537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.298899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.299636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.301251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.312169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1174/2360] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:02:23.318870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.329616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e510ff-3979-4531-bf26-78b42ec930af admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.334286 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.334975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.335261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.335541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.336273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.337908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdefbb1-b979-4d43-8ccb-b31e1653c40a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.347796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1187/2361] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:02:23.357531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.367908 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ceb778-c96c-4eb3-8180-7e684a217f6e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.372584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.373499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.373783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.374059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] PATH_INFO: `/v3/projects/e32f133f3ebb4e12bf5e7178194b1fcb/users/336d50fac858407ab3f7102bf3172a1f/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.389512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32f133f3ebb4e12bf5e7178194b1fcb, user_id=336d50fac858407ab3f7102bf3172a1f, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.392422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.466499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1175/2362] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:02:23 2022] PUT /identity/v3/projects/e32f133f3ebb4e12bf5e7178194b1fcb/users/336d50fac858407ab3f7102bf3172a1f/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:23.476511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.476807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.477150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.503849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] MFA Rules not processed for user `336d50fac858407ab3f7102bf3172a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:23.505276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:23.569005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1188/2363] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:23.580682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:23.582458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:23.644612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28584-9428-48bf-8357-94922f67c9ce admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:23.644612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:23.647856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:23.648199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:23.648483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:23.657442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:23.658892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599de54-4698-4911-97f6-bbf12fc9fa9d service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:23.668375 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1176/2364] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:26.649023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:26.711349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2989e-0854-4927-b488-4483ab55db82 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:26.716835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:26.718110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:26.718110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:26.718299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] PATH_INFO: `/v3/users/336d50fac858407ab3f7102bf3172a1f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:26.719496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=336d50fac858407ab3f7102bf3172a1f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:26.721466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:26.900237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336d50fac858407ab3f7102bf3172a1f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:26.900899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336d50fac858407ab3f7102bf3172a1f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:26.907651 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336d50fac858407ab3f7102bf3172a1f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.007534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336d50fac858407ab3f7102bf3172a1f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.008387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336d50fac858407ab3f7102bf3172a1f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.026881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1189/2365] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:02:26 2022] DELETE /identity/v3/users/336d50fac858407ab3f7102bf3172a1f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:27.031380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:27.031904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:27.031904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:27.048462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:27.049688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:27.110535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1177/2366] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:27.120606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:27.122047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:27.178632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0b234-053d-47c5-ab67-acc9092aa06b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:27.182264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:27.182905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:27.183194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:27.183488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:27.192278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:27.193742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5570a75-f839-41b8-b3ef-df2ad3b1791e service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:27.203010 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1190/2367] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:27.606337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:27.607887 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:27.630209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a4cbf-a282-484f-a02d-98229b464633 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:27.636242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:27.637166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:27.637452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:27.637729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] PATH_INFO: `/v3/projects/e32f133f3ebb4e12bf5e7178194b1fcb` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:27.638933 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32f133f3ebb4e12bf5e7178194b1fcb)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:27.640848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:27.767706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32f133f3ebb4e12bf5e7178194b1fcb', 'request_id': 'req-8bed2b30-1b51-4481-97a0-4425730fd190'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.775196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32f133f3ebb4e12bf5e7178194b1fcb', 'request_id': 'req-8bed2b30-1b51-4481-97a0-4425730fd190'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.867533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32f133f3ebb4e12bf5e7178194b1fcb', 'request_id': 'req-8bed2b30-1b51-4481-97a0-4425730fd190'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.879216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] The token cache is being invalidate because project e32f133f3ebb4e12bf5e7178194b1fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:02:27.879690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.880316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bed2b30-1b51-4481-97a0-4425730fd190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:27.883461 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1178/2368] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:02:27 2022] DELETE /identity/v3/projects/e32f133f3ebb4e12bf5e7178194b1fcb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:27.888452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:27.888947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:27.889326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:27.908129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:27.909370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:27.968493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1191/2369] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:02:27.976357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:27.976641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:27.976920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:27.995402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:27.996589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:28.004448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1179/2370] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:28.009507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.019401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c912d-6e75-4af2-b621-238449b5de7d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.024577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.025268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.025588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.025868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.026591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:02:28.026901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.028503 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.041152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1192/2371] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:02:28.045455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.054999 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ead82e-b272-424d-87c7-774effc1897c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.061641 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.062311 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.068030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.068030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.068030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.068030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.179984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1180/2372] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:02:28 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:02:28.183200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.192093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c642c-d022-4999-8dcf-ac8a56586a7e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.268945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.269616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.270045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.270332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.271035 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.274250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.402047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1193/2373] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:02:28 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:02:28.403300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.413457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2610-262d-4437-b809-748421522be5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.417967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.418608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.418894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.419168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.420274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.421514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.432299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1181/2374] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:02:28.436621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.448353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84c726-defc-4d10-a1d2-31966dbe03c8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.453001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.453758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.454110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.454331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.455093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.456690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646fa10-6a8b-4e39-b502-d41320473435 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.469584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1194/2375] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:02:28.473630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.483379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9ddb8-0265-4348-af38-621d6e77d723 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.488214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.489120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.489409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.489685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] PATH_INFO: `/v3/projects/f5e502518cef4089a4cee7d988a929cd/users/21e864227e894796be9ba8247e1076b7/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.504519 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e502518cef4089a4cee7d988a929cd, user_id=21e864227e894796be9ba8247e1076b7, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.507957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.562962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1182/2376] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:02:28 2022] PUT /identity/v3/projects/f5e502518cef4089a4cee7d988a929cd/users/21e864227e894796be9ba8247e1076b7/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:28.574512 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.574796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.575081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.601146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] MFA Rules not processed for user `21e864227e894796be9ba8247e1076b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:28.602411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:28.665292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1195/2377] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:02:28.676169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:28.677879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:28.735945 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93d4f0-a239-420c-a932-fd5f8bbd5f5d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:28.739709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:28.740359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:28.740645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:28.741484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:28.750069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:28.751514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72d8a-9dc1-416e-ae4b-796d0b55b048 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:28.761259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1183/2378] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:37.864553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:37.866408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:37.921350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e4fbb-8819-4828-affb-0549e5baf98b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:37.925344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:37.925983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:37.926269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:37.926546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:37.928296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:37.989141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:37.991141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:38.000455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1196/2379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:51.563458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db66a-8d5d-4365-b417-76cb8318f47d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:51.563926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db66a-8d5d-4365-b417-76cb8318f47d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:51.564010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9db66a-8d5d-4365-b417-76cb8318f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:51.581796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-da9db66a-8d5d-4365-b417-76cb8318f47d None None] MFA Rules not processed for user `da86fdd1a57d4a319f1158e76079ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:51.583136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-da9db66a-8d5d-4365-b417-76cb8318f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:51.646493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1184/2380] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:02:55.914261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:55.974747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278ccfa-f808-4d1c-9e3b-ba74e026d280 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:55.979272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:55.980145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:55.980434 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:55.980713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] PATH_INFO: `/v3/users/21e864227e894796be9ba8247e1076b7` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:55.981975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e864227e894796be9ba8247e1076b7)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:55.983896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:56.147911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e864227e894796be9ba8247e1076b7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.148606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e864227e894796be9ba8247e1076b7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.155252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e864227e894796be9ba8247e1076b7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.231218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e864227e894796be9ba8247e1076b7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.231764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e864227e894796be9ba8247e1076b7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.249435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1197/2381] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:02:55 2022] DELETE /identity/v3/users/21e864227e894796be9ba8247e1076b7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:02:56.254049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:56.254529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:56.254693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:56.273068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:02:56.277029 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:56.340988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1185/2382] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:02:56.350928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:56.352322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:56.407699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e292554-9bee-4764-8dfe-f65c13e10171 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:56.411312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:56.411972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:56.412258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:56.412533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:56.421281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:56.422706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816fd35-0186-4aee-baa1-25e7ed7ab028 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:56.432672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1198/2383] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:02:56.814347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:02:56.815760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:02:56.833127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1c93b-1840-4718-a5bd-658742244c90 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:02:56.838664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:02:56.839750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:02:56.840122 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:02:56.840298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] PATH_INFO: `/v3/projects/f5e502518cef4089a4cee7d988a929cd` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:02:56.846987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e502518cef4089a4cee7d988a929cd)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:02:56.846987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:02:56.953222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e502518cef4089a4cee7d988a929cd', 'request_id': 'req-f82acde8-9955-4d71-a752-dde881a6ec6c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:56.959011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e502518cef4089a4cee7d988a929cd', 'request_id': 'req-f82acde8-9955-4d71-a752-dde881a6ec6c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:57.042986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e502518cef4089a4cee7d988a929cd', 'request_id': 'req-f82acde8-9955-4d71-a752-dde881a6ec6c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:57.054687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] The token cache is being invalidate because project f5e502518cef4089a4cee7d988a929cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:02:57.057104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:57.057104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:02:57.057431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1186/2384] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:02:56 2022] DELETE /identity/v3/projects/f5e502518cef4089a4cee7d988a929cd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:03:06.382153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:06.382631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:06.382744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:06.400412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] MFA Rules not processed for user `f77d9e1f887e4b55ae8e982c00a735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:03:06.401642 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:06.454535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1199/2385] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:03:18.190911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:18.192293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:18.249135 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82acde8-9955-4d71-a752-dde881a6ec6c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:18.252836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:18.253548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:18.253827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:18.254099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:18.256542 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:18.329714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:18.331208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:18.342894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1187/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:18.629748 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:18.631363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:18.643905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60978a-159f-4b7b-bcf2-6df9b6fc7a57 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:18.647523 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:18.648193 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:18.648484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:18.648805 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:18.650652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:18.664886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:18.666357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f9520-01fe-45e5-afac-f74bf596336c service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:18.677944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1200/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:27.267930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:27.269401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:27.334931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769342a-6797-40d4-9352-33d4362f74dd service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:27.339743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:27.340612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:27.340897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:27.341212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] PATH_INFO: `/v3/users/bd728e8c7e15442aba7adf1657d4b847` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:27.342573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd728e8c7e15442aba7adf1657d4b847)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:27.344728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:27.519098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd728e8c7e15442aba7adf1657d4b847'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:27.527076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd728e8c7e15442aba7adf1657d4b847'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:27.527795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd728e8c7e15442aba7adf1657d4b847'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:27.602585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd728e8c7e15442aba7adf1657d4b847'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:27.603488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd728e8c7e15442aba7adf1657d4b847'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:27.620898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1188/2388] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:03:27 2022] DELETE /identity/v3/users/bd728e8c7e15442aba7adf1657d4b847 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:03:27.678745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:27.679260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:27.679346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:27.697837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] MFA Rules not processed for user `e2074c33e19940eba5fc2ac957f5636a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:03:27.699076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:27.766798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1201/2389] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:03:27.780133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:27.781625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:27.855855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3d28e-4328-442b-9802-96ff0261ab99 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:27.861442 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:27.862085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:27.862400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:27.862673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:27.864702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:27.873130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:27.874695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:27.875708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:27.877951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:27.889626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1189/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:03:27.946801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7daeb-d622-4a86-ac95-1ca245694360 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:27.951660 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:27.952521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:27.952808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:27.953125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] PATH_INFO: `/v3/projects/3fea3a5000ad4c90ab5592f86534b5c1` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:27.954314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fea3a5000ad4c90ab5592f86534b5c1)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:27.956226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:28.048517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fea3a5000ad4c90ab5592f86534b5c1', 'request_id': 'req-32472633-d9c4-43f3-8cdb-35ee58d65348'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:28.054700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fea3a5000ad4c90ab5592f86534b5c1', 'request_id': 'req-32472633-d9c4-43f3-8cdb-35ee58d65348'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:28.109590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fea3a5000ad4c90ab5592f86534b5c1', 'request_id': 'req-32472633-d9c4-43f3-8cdb-35ee58d65348'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:28.123822 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] The token cache is being invalidate because project 3fea3a5000ad4c90ab5592f86534b5c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:03:28.124117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:28.124785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:03:28.126432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1202/2391] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:03:27 2022] DELETE /identity/v3/projects/3fea3a5000ad4c90ab5592f86534b5c1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:03:28.207280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:28.208971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:28.270203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab1e0f-a410-4c83-a055-b602a648ddcc service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:28.322080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:28.322663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:28.322952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:28.323232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:28.325017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:28.334417 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:28.335855 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:28.343635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1190/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:28.742671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:28.744174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:28.813079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32472633-d9c4-43f3-8cdb-35ee58d65348 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:28.818742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:28.819391 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:28.819674 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:28.819950 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:28.821740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:28.832753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:28.834311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:28.843836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1203/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:38.319843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:38.321281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:38.331362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99881af6-273c-4839-b059-a4e10ff93bd1 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:38.335902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:38.336545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:38.336838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:38.337158 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:38.338972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:38.349686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:38.351260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:38.359439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1191/2394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:38.487962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:38.489936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:38.547228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb8d8-a109-4dfc-b3ff-3f7bbc6a4594 service placement] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:38.550956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:38.552154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:38.552432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:38.552702 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:38.554538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:38.613114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:38.614556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:38.624040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1204/2395] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:03:46.719035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:03:46.720503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:46.796233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b271e-b2d7-43b4-9e2c-91e1c3ef7ea2 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:03:46.802532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:03:46.803191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:03:46.803477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:03:46.803749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:03:46.805598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:03:46.818120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:03:46.819717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:03:46.830253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1192/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:03:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:00.983813 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:00.996517 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b1e10-9093-4cf7-9335-6e67632d37c3 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:01.001885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:01.002516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:01.002797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:01.003071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:01.005464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:01.062789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:01.064379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:01.073542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1205/2397] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:02.985345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:02.986479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:02.998430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fc1f7-cf79-4a85-a286-ed7c7bb20d56 service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:03.002201 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:03.002875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:03.003142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:03.003455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:03.005293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:03.067340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:03.068788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:03.078783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1193/2398] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:07.012053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:07.014039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:07.029030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae640-24ed-4194-b066-f616a9c1f7bd service nova] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:07.034684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:07.034684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:07.035575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:07.035814 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] PATH_INFO: `/v3/users/da86fdd1a57d4a319f1158e76079ea6b` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:07.037009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=da86fdd1a57d4a319f1158e76079ea6b)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:07.039043 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:07.260231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da86fdd1a57d4a319f1158e76079ea6b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.260809 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da86fdd1a57d4a319f1158e76079ea6b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.267302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da86fdd1a57d4a319f1158e76079ea6b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.327647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da86fdd1a57d4a319f1158e76079ea6b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.328260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-004c9e91-903e-4640-85da-67cf27bd28ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da86fdd1a57d4a319f1158e76079ea6b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.345493 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1206/2399] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:04:07 2022] DELETE /identity/v3/users/da86fdd1a57d4a319f1158e76079ea6b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:04:07.582004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:07.592020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a99a8-504a-43e0-a2e2-0b6f750141ae service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:07.648560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:07.649451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:07.649738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:07.650014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] PATH_INFO: `/v3/projects/4e3208970f45410aa44db86da14ae159` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:07.651187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3208970f45410aa44db86da14ae159)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:07.653116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:07.776685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3208970f45410aa44db86da14ae159', 'request_id': 'req-69844501-e524-456e-bb44-1e017cdee592'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.782142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3208970f45410aa44db86da14ae159', 'request_id': 'req-69844501-e524-456e-bb44-1e017cdee592'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.853884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3208970f45410aa44db86da14ae159', 'request_id': 'req-69844501-e524-456e-bb44-1e017cdee592'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.865512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] The token cache is being invalidate because project 4e3208970f45410aa44db86da14ae159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:04:07.865745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.866384 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-69844501-e524-456e-bb44-1e017cdee592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:04:07.867924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1194/2400] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:04:07 2022] DELETE /identity/v3/projects/4e3208970f45410aa44db86da14ae159 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:04:07.872884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:07.874925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:07.874925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:07.891307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:07.892555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:07.949295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1207/2401] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:07.957602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:07.957928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:07.958210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:07.975915 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:07.977143 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:07.985069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1195/2402] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:07.989291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:07.998881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b0879-6f89-4ef1-98a7-4f741ccb4bb2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.004175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.004823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.005150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.005428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.006147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:04:08.006453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.008036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.020430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1208/2403] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:04:08.024509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.033662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c17a2-ef8d-49c5-b641-541049d592f4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.038804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.039482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.039765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.040042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.040733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.042683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.135249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1196/2404] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:04:08 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:04:08.139382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.150126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea310fc-acb0-4f6f-a60d-c163201a9bf7 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.205722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.206400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.206955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.207124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.207816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.209786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.276726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1209/2405] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:04:08 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:04:08.280919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.291795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4758f9-61f3-40c6-aa84-b3c62c186f1b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.296227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.296860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.297177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.297453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.298279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.299874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.310214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1197/2406] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:04:08.317647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.327671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f22b0-2cec-4205-85c2-3bdb563bbe39 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.333320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.333970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.334254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.334529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.335246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.336831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad167cd-2c9f-4468-a702-9e15c118e135 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.346699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1210/2407] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:04:08.351899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.361651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417a85d-7bf3-4393-9d6d-ff8ed4c3d220 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.366826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.367696 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.367975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.368277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] PATH_INFO: `/v3/projects/2c353aef3e574c449532b2c4a2bb08b1/users/105bf4104bf949168bbe5c2c7eea0602/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.383843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c353aef3e574c449532b2c4a2bb08b1, user_id=105bf4104bf949168bbe5c2c7eea0602, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.386540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.460272 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1198/2408] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:04:08 2022] PUT /identity/v3/projects/2c353aef3e574c449532b2c4a2bb08b1/users/105bf4104bf949168bbe5c2c7eea0602/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:04:08.465437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37427a1-17f5-4aad-a77c-6525908c9ece None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.465736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37427a1-17f5-4aad-a77c-6525908c9ece None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.466017 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37427a1-17f5-4aad-a77c-6525908c9ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.483977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c37427a1-17f5-4aad-a77c-6525908c9ece None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:08.485205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c37427a1-17f5-4aad-a77c-6525908c9ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:08.543337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1211/2409] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:04:08.552317 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:08.554032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:08.609523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcd0a1-425d-4ccd-a981-e01ccc2d35a1 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:08.613266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:08.613913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:08.614198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:08.614474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:08.623435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:08.624940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:08.634796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1199/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:14.213339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94c39-d8c4-432a-919d-e7058417c194 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:14.213798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94c39-d8c4-432a-919d-e7058417c194 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:14.214040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d94c39-d8c4-432a-919d-e7058417c194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:14.251829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d1d94c39-d8c4-432a-919d-e7058417c194 None None] MFA Rules not processed for user `105bf4104bf949168bbe5c2c7eea0602`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:14.258223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d1d94c39-d8c4-432a-919d-e7058417c194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:14.330342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1212/2411] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:14.345738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:14.346329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:14.437421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213944-2855-4ce5-a5bd-a14b47b5c592 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:14.443458 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:14.444127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:14.444413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:14.444695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:14.453757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:14.455363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8033c-9e5e-483b-9362-e3b65395d694 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:14.466656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1200/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:16.954723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:16.955188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:16.955334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:16.975097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] MFA Rules not processed for user `105bf4104bf949168bbe5c2c7eea0602`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:16.976305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:16.989061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1213/2413] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:23.911314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a05e-800a-4273-9a94-065593911ae5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:23.912225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a05e-800a-4273-9a94-065593911ae5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:23.912509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390a05e-800a-4273-9a94-065593911ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:23.932618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-f390a05e-800a-4273-9a94-065593911ae5 None None] MFA Rules not processed for user `f77d9e1f887e4b55ae8e982c00a735e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:23.933870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f390a05e-800a-4273-9a94-065593911ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:23.990717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1201/2414] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:24.307785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:24.320821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32795f78-54bc-4f89-acc9-a6b4ecf28ead None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:24.322752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:24.323466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:24.323819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:24.324168 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:24.326109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:24.336728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:24.338306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330a7f6-6b9c-4b20-be3f-fbd6f8fc35f0 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:24.347971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1214/2415] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:26.017913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.019052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.020193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.021118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1202/2416] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:04:26.029927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe5ba-3ffc-41c5-b428-689fe167f868 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.030400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe5ba-3ffc-41c5-b428-689fe167f868 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.030498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe5ba-3ffc-41c5-b428-689fe167f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.051952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c56fe5ba-3ffc-41c5-b428-689fe167f868 None None] MFA Rules not processed for user `9a8e3bf8abe544a98ba074737674ab93`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:26.053613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c56fe5ba-3ffc-41c5-b428-689fe167f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:26.066528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1215/2417] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:26.079156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:26.081815 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:26.095163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801205ce-24b2-4885-9cb2-c0566e7ef935 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:26.099386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:26.100146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.100432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.104873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.116100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:26.118009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:26.126840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1203/2418] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:26.235186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279f0c-d88c-4873-90d8-a598dfec353b None None] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.235575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279f0c-d88c-4873-90d8-a598dfec353b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.236508 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279f0c-d88c-4873-90d8-a598dfec353b None None] PATH_INFO: `/` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.238415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1216/2419] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:04:26.240941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:26.244234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.245329 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.245855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.270397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd7d8-1f7e-46de-bbb4-2a22ef4f8d50 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:26.273279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:26.273547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.273835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.275076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.276976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:26.291663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:26.293190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:26.294364 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:26.296124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:26.305724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1217/2420] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:04:26.308586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1204/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:04:26.321985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:26.331761 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09acd79-7202-462b-810d-c3035b037bb6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:26.335489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:26.336126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:26.336436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:26.336711 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:26.348464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:26.349926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c447fe6-ce7d-4d51-8570-f49c4880c0c5 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:26.363908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1218/2422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:32.948160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:32.950313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:32.964614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed7390-3937-496f-8378-30015f2e343d service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:32.970503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:32.971165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:32.971484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:32.971975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:32.973921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:32.987606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:32.989435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:33.004304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1205/2423] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:04:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:04:42.454541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcda9-e3fc-4c2d-ac6a-bf3d6e91b89a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:42.455023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcda9-e3fc-4c2d-ac6a-bf3d6e91b89a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:42.455122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dcda9-e3fc-4c2d-ac6a-bf3d6e91b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:42.473184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-762dcda9-e3fc-4c2d-ac6a-bf3d6e91b89a None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:42.475856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-762dcda9-e3fc-4c2d-ac6a-bf3d6e91b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:42.538138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1219/2424] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:04:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:04:42.709897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:04:42.712260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:42.781911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689789e-3fe2-4f09-9aed-6d2d97131954 service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:04:42.787726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:04:42.790389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:42.790389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:42.790389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:42.797583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:04:42.799198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918fa2c-0d4d-437f-870f-19348a037112 service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:04:42.807063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1206/2425] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:04:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:04:55.434564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066700-1e32-4109-8994-06eaa8572947 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:04:55.435075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066700-1e32-4109-8994-06eaa8572947 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:04:55.435177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066700-1e32-4109-8994-06eaa8572947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:04:55.453355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f4066700-1e32-4109-8994-06eaa8572947 None None] MFA Rules not processed for user `e6a24932d7894c199f1374b9203c3873`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:04:55.454497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f4066700-1e32-4109-8994-06eaa8572947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:04:55.507641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1220/2426] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:04:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:00.008425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:00.012445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:00.012445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] PATH_INFO: `/` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:00.012445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1207/2427] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 11 13:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 13:05:00.017873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb761d-ea7d-4a60-a5db-b984a51579d3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:00.018916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb761d-ea7d-4a60-a5db-b984a51579d3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:00.019608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb761d-ea7d-4a60-a5db-b984a51579d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:00.038731 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2eeb761d-ea7d-4a60-a5db-b984a51579d3 None None] MFA Rules not processed for user `9bd3d5788bc74f70a942f44f2f38dfca`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:00.040182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2eeb761d-ea7d-4a60-a5db-b984a51579d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:00.050313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1221/2428] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 11 13:05:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:00.063722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:00.068336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:00.136718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c3808-ae1b-40e3-8a7c-2450fd3ac4e2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:00.140269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:00.140902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:00.141219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:00.141496 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:00.152466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:00.153972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:00.165186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1208/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:05:03.374322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38c6d-a05d-4ad8-b076-ada8dd264887 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:03.374774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38c6d-a05d-4ad8-b076-ada8dd264887 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:03.374886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e38c6d-a05d-4ad8-b076-ada8dd264887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:03.393008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-02e38c6d-a05d-4ad8-b076-ada8dd264887 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:03.394502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-02e38c6d-a05d-4ad8-b076-ada8dd264887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:03.401643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1222/2430] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:03.414245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:03.425898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f338-69a8-4fb1-b6f4-65fe3e469589 service glance] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:03.430919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:03.431561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:03.431867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:03.432144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:03.440765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:03.442397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:03.450509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1209/2431] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:05:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:05:21.540860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:21.541484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:21.541659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:21.561527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:21.562759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:21.570775 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1223/2432] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:21.583079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:21.595153 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db957729-6080-40f9-aac9-df678483b7e6 service swift] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:21.600471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:21.601142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:21.601424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:21.601699 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:21.609748 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:21.611959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:21.619932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1210/2433] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:05:49.822606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:49.831687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37571-16aa-4f5e-ad7c-594536fd341a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:49.836241 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:49.836868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:49.837195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:49.837471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:49.839177 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:49.851522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:49.852929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:49.862184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1224/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:05:53.859009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:53.860551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:53.880499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de22dec-e24c-47e9-b28e-987aec758447 service swift] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:53.885223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:53.886089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:53.886373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:53.886649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] PATH_INFO: `/v3/users/f77d9e1f887e4b55ae8e982c00a735e0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:53.887841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77d9e1f887e4b55ae8e982c00a735e0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:53.889844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:54.112182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77d9e1f887e4b55ae8e982c00a735e0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.119408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77d9e1f887e4b55ae8e982c00a735e0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.122142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77d9e1f887e4b55ae8e982c00a735e0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.224419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77d9e1f887e4b55ae8e982c00a735e0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.225051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-39b392a9-2f6a-4451-af44-bd9a08d07341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77d9e1f887e4b55ae8e982c00a735e0'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.242790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1211/2435] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:05:53 2022] DELETE /identity/v3/users/f77d9e1f887e4b55ae8e982c00a735e0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:54.507931 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:54.524199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5699409-a532-4156-9838-04f4f28838d2 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:54.581698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:54.583246 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:54.583549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:54.583831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] PATH_INFO: `/v3/projects/c9b8255d3f93411b94ed87118f74d7eb` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:54.585062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b8255d3f93411b94ed87118f74d7eb)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:54.587094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:54.715716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b8255d3f93411b94ed87118f74d7eb', 'request_id': 'req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.721185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b8255d3f93411b94ed87118f74d7eb', 'request_id': 'req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.841018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b8255d3f93411b94ed87118f74d7eb', 'request_id': 'req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.852222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] The token cache is being invalidate because project c9b8255d3f93411b94ed87118f74d7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:05:54.852507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.853150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6477f8a6-d0af-4c82-b91a-3f4a71040eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:54.854685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1225/2436] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:05:54 2022] DELETE /identity/v3/projects/c9b8255d3f93411b94ed87118f74d7eb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:54.859633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:54.860121 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:54.860233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:54.877512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:54.878769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:54.937268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1212/2437] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:54.945579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:54.945869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:54.946147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:54.966507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:54.967722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:54.975641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1226/2438] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:05:54.979867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:54.990055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c7893-76c5-436a-970d-7e413a1a3896 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:54.995299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:54.995970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:54.996258 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:54.996537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:54.997334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:05:54.997648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:54.999298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.016831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1213/2439] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:05:55.021801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.031015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27ddb-bbaf-49e2-8735-755beee84d5c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.035871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.036515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.036794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.037087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.037781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.039661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.165951 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1227/2440] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:05:55 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:05:55.167110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.178096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a98fee-26f8-4fbb-bcde-d86163bbeccc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.232916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.233543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.233864 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.234139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.234811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.236722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.390388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1214/2441] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:05:55 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:05:55.393812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.404626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5068c5-9d6c-4111-b655-d2b7373d3211 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.409219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.409866 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.410672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.411202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.411967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.413584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.423216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1228/2442] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:55.427661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.437808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65278ce0-8d2b-4185-b602-c8d0750c9ef7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.442497 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.443154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.443437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.443713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.444432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.446185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231099e-3b3a-49c4-a815-c72e41f33fd7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.456369 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1215/2443] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:55.460679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.471567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a06d-2dc6-4ca5-bf4b-e1a31466fb69 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.478384 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.479263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.479541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.479816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] PATH_INFO: `/v3/projects/7288962f4b084001bba3786876e67142/users/033c8c27195d489aaf147eab646deb02/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.497139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7288962f4b084001bba3786876e67142, user_id=033c8c27195d489aaf147eab646deb02, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.499804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.635563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1229/2444] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:05:55 2022] PUT /identity/v3/projects/7288962f4b084001bba3786876e67142/users/033c8c27195d489aaf147eab646deb02/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:05:55.645944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.646237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.646517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.672623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] MFA Rules not processed for user `033c8c27195d489aaf147eab646deb02`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:55.673841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:55.741025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1216/2445] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:55.752221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:55.754322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:55.826271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556bc9-19d5-40e5-962c-be1be9b49337 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:55.831859 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:55.832552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:55.832837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:55.833148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:55.841128 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:55.842705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2543e-b9d3-4e35-85c5-636b4dc8ecd3 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:55.852095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1230/2446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:05:56.066119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:56.125844 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde8105-4fb6-415f-9914-4462b355736a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:56.130538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:56.131390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:56.131668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:56.131937 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] PATH_INFO: `/v3/users/033c8c27195d489aaf147eab646deb02` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:56.133126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033c8c27195d489aaf147eab646deb02)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:56.135039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:56.401545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033c8c27195d489aaf147eab646deb02'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:56.408020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033c8c27195d489aaf147eab646deb02'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:56.408676 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033c8c27195d489aaf147eab646deb02'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:56.474484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033c8c27195d489aaf147eab646deb02'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:56.475098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033c8c27195d489aaf147eab646deb02'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:56.491911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1217/2447] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:05:56 2022] DELETE /identity/v3/users/033c8c27195d489aaf147eab646deb02 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:56.496513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:56.496802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:56.497113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:56.513705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:56.514898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:56.573412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1231/2448] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:56.583363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:56.584714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:56.639643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc74088-23b0-420f-b60e-3ce347f53851 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:56.643262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:56.643897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:56.644180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:56.644455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:56.654640 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:56.656005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec145f-1039-40f2-86c3-387c73195ac0 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:56.665525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1218/2449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:05:57.122238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.137088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:57.137088 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff7c5-3650-4c40-9ebe-05e5c7ae62a8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.141464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.142370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.142654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.142925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] PATH_INFO: `/v3/projects/7288962f4b084001bba3786876e67142` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.145358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7288962f4b084001bba3786876e67142)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.147421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.256242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7288962f4b084001bba3786876e67142', 'request_id': 'req-d67d593b-7cbf-4be4-a90c-97535a6c749a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:57.261327 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7288962f4b084001bba3786876e67142', 'request_id': 'req-d67d593b-7cbf-4be4-a90c-97535a6c749a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:57.337093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7288962f4b084001bba3786876e67142', 'request_id': 'req-d67d593b-7cbf-4be4-a90c-97535a6c749a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:57.348288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] The token cache is being invalidate because project 7288962f4b084001bba3786876e67142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:05:57.348575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:57.349233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-d67d593b-7cbf-4be4-a90c-97535a6c749a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:05:57.350782 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1232/2450] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:05:57 2022] DELETE /identity/v3/projects/7288962f4b084001bba3786876e67142 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:57.356426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.356965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.356965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.374343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:57.375559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:57.432471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1219/2451] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:57.441411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.442330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.442663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.467964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:57.470148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:57.480763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1233/2452] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:57.484967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.494494 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6e67f-40c0-440f-b4f3-3c8523ff33b2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.499172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.499827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.500115 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.500386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.501139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:05:57.501446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.503028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.514769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1220/2453] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:05:57.518918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.528629 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75820-dfd3-4b63-94a6-d46c504d4b4a None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.533320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.533959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.534240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.534515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.535201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.537315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.631547 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1234/2454] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:05:57 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:05:57.636060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.646619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0569d-ded7-4152-8123-d8b2b07aa790 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.701692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.702367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.702646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.702918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.703599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.705541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.824386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1221/2455] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:05:57 2022] POST /identity/v3/users => generated 305 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:05:57.828450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.838535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e44e3-dbf1-4e73-8ad8-67c2380a42d5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.843113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.843763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.844047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.844322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.845060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.846670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.857496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1235/2456] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:57.863180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.873879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c44a5-fad6-47cf-8f0a-6d375b2361d5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.878482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.879799 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.880142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.880413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.881163 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.882754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8958c-f196-4a5e-a212-8a53eb8f1611 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:57.892427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1222/2457] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:57.896835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:57.906524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22bea3-d2b4-4e1e-89a4-4b6a61bf5449 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:57.911078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:57.911940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:57.912219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:57.912487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] PATH_INFO: `/v3/projects/ec7e5ad157604786a54e9aa236d4cf00/users/24faea891b9f4000b75243e4abeee833/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:57.926882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7e5ad157604786a54e9aa236d4cf00, user_id=24faea891b9f4000b75243e4abeee833, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:57.929582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.000260 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1236/2458] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:05:57 2022] PUT /identity/v3/projects/ec7e5ad157604786a54e9aa236d4cf00/users/24faea891b9f4000b75243e4abeee833/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:05:58.011370 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.011669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.011950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.037956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] MFA Rules not processed for user `24faea891b9f4000b75243e4abeee833`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:58.039204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:58.101429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1223/2459] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:58.105826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.165647 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ae45e-42ec-4ee9-a544-6b6030924a14 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.170271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.170917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.171201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.171581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.172275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.174204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.271212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1237/2460] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:05:58 2022] POST /identity/v3/projects => generated 409 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:05:58.275068 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.286060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fbcc3-7e42-4e70-9700-15c3537b9653 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.342574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.343245 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.343528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.343801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.344523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.346467 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.418203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1224/2461] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:05:58 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:05:58.422266 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.433718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f02c-b4a4-4604-8be7-95f96c5af2d5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.438368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.439021 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.439308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.439609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.440328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.442790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.453167 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1238/2462] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:58.457385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.467278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a94bf-7011-42e8-a7b9-1415f4563f55 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.471810 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.472670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.473662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.473938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] PATH_INFO: `/v3/projects/793994fa92fe4e6f8b48919d46ab715b/users/0361bb3ab1394005992cb44673779ecc/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.487759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793994fa92fe4e6f8b48919d46ab715b, user_id=0361bb3ab1394005992cb44673779ecc, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.491204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.600493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1225/2463] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:05:58 2022] PUT /identity/v3/projects/793994fa92fe4e6f8b48919d46ab715b/users/0361bb3ab1394005992cb44673779ecc/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:58.604698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.615277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b1f1-7047-4501-a8b6-fc5f95ff157f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.673575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.674157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.674443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.674722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.675442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.677783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96533f4f-4e14-4485-8c42-b9f3788d6edf admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.687308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1239/2464] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:05:58.691445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.701540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29fb2-bcf3-403e-b030-1ceb20062297 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.706156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.707022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.707373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.707373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] PATH_INFO: `/v3/projects/793994fa92fe4e6f8b48919d46ab715b/users/0361bb3ab1394005992cb44673779ecc/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.709559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=793994fa92fe4e6f8b48919d46ab715b, user_id=0361bb3ab1394005992cb44673779ecc, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.712204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.722242 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1226/2465] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:05:58 2022] PUT /identity/v3/projects/793994fa92fe4e6f8b48919d46ab715b/users/0361bb3ab1394005992cb44673779ecc/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:05:58.732725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.733057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.733357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.760823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] MFA Rules not processed for user `0361bb3ab1394005992cb44673779ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:05:58.762076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:58.827157 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1240/2466] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:05:58.838938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:58.840665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:05:58.897327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f39be4-04a5-4a3e-a8e2-a3deba6fa8fa admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:58.901173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:58.901805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:58.902084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:58.902356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:58.912194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:58.913653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:58.922987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1227/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:05:59.317443 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:05:59.327124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f372b-5b1f-4667-940b-393dfbc940fd None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:05:59.330712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:05:59.331345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:05:59.331626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:05:59.331922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:05:59.386494 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:05:59.387933 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:05:59.396812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1241/2468] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:09.860536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:09.862069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:09.887161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:09.928807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134eef6-1742-4fb6-bfbb-d4cba8bafed7 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:09.932794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:09.934100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:09.934100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:09.934916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:09.936920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:09.965141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081e3e-7835-44d0-8146-3b302fe10d71 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:09.969956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:09.970827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:09.971119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:09.971402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] PATH_INFO: `/v3/users/24faea891b9f4000b75243e4abeee833` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:09.972618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] RBAC: Authorizing `identity:delete_user(user_id=24faea891b9f4000b75243e4abeee833)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:09.974580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:09.997161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:09.998606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fc6c-978c-4ecf-9ccc-41d24befd525 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:10.008618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1228/2469] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:06:10.225305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24faea891b9f4000b75243e4abeee833'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:10.225953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24faea891b9f4000b75243e4abeee833'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:10.232487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24faea891b9f4000b75243e4abeee833'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:10.315413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24faea891b9f4000b75243e4abeee833'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:10.315969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24faea891b9f4000b75243e4abeee833'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:10.335489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1242/2470] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:09 2022] DELETE /identity/v3/users/24faea891b9f4000b75243e4abeee833 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:10.340000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:10.340394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:10.340749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:10.361562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:10.363478 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:10.435911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1229/2471] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:10.446884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:10.448278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:10.505658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa4b4-cfc4-448f-a896-eb57e10eafca admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:10.509336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:10.510008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:10.510429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:10.510715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:10.519873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:10.521794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:10.531944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1243/2472] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:10.963288 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:10.965328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:10.987771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473605c-6430-4d28-9c7f-5a1534d1946a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:10.993033 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:10.993898 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:10.994186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:10.994586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] PATH_INFO: `/v3/projects/ec7e5ad157604786a54e9aa236d4cf00` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:10.995790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7e5ad157604786a54e9aa236d4cf00)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:10.997781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:11.145645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7e5ad157604786a54e9aa236d4cf00', 'request_id': 'req-372e829d-56cb-4115-bb5d-c138d62400a9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.151113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7e5ad157604786a54e9aa236d4cf00', 'request_id': 'req-372e829d-56cb-4115-bb5d-c138d62400a9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.241566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7e5ad157604786a54e9aa236d4cf00', 'request_id': 'req-372e829d-56cb-4115-bb5d-c138d62400a9'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.260154 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] The token cache is being invalidate because project ec7e5ad157604786a54e9aa236d4cf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:11.260452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.261134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.264651 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1230/2473] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:10 2022] DELETE /identity/v3/projects/ec7e5ad157604786a54e9aa236d4cf00 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:11.269328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:11.284568 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7eec8-dadd-460b-8c1b-3a0677ea8406 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:11.346784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:11.349432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:11.349432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:11.349432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] PATH_INFO: `/v3/users/0361bb3ab1394005992cb44673779ecc` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:11.350586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0361bb3ab1394005992cb44673779ecc)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:11.352721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:11.538208 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0361bb3ab1394005992cb44673779ecc'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.539085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0361bb3ab1394005992cb44673779ecc'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.547259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0361bb3ab1394005992cb44673779ecc'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.663465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0361bb3ab1394005992cb44673779ecc'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.664089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c733d279-8b6c-43c6-a2cf-e9fba44615a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0361bb3ab1394005992cb44673779ecc'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:11.687821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1244/2474] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:11 2022] DELETE /identity/v3/users/0361bb3ab1394005992cb44673779ecc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:12.214028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:12.223795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:12.232097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e829d-56cb-4115-bb5d-c138d62400a9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:12.294959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:12.298344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.298344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.298344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] PATH_INFO: `/v3/projects/793994fa92fe4e6f8b48919d46ab715b` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.298344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=793994fa92fe4e6f8b48919d46ab715b)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:12.299586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:12.428845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793994fa92fe4e6f8b48919d46ab715b', 'request_id': 'req-1c2570c2-b2d1-4d99-9330-12194f0dab9d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:12.434097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793994fa92fe4e6f8b48919d46ab715b', 'request_id': 'req-1c2570c2-b2d1-4d99-9330-12194f0dab9d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:12.532275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793994fa92fe4e6f8b48919d46ab715b', 'request_id': 'req-1c2570c2-b2d1-4d99-9330-12194f0dab9d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:12.544415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] The token cache is being invalidate because project 793994fa92fe4e6f8b48919d46ab715b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:12.544706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:12.545355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-1c2570c2-b2d1-4d99-9330-12194f0dab9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:12.547081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1231/2475] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:12 2022] DELETE /identity/v3/projects/793994fa92fe4e6f8b48919d46ab715b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:12.552580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.553098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.553249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.570619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:12.571817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:12.631795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1245/2476] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:12.639342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.639685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.639967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.658355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:12.659541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:12.668605 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1232/2477] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:12.672665 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:12.682097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c7558-be24-4892-83d2-eec056279001 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:12.686558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:12.687203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.687487 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.687766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.688486 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:12.688929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:12.690543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:12.702668 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1246/2478] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:06:12.707735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:12.717014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259292-7b0b-4a76-92b0-8ad68f2cf80d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:12.721785 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:12.722987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.723268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.723544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.724225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:12.726175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:12.809071 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1233/2479] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:12 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:12.813032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:12.824555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0b167-e104-4ef5-be07-2cd1842bf3d2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:12.892256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:12.893218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:12.893844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:12.895278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:12.898934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:12.902249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:12.981752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:12.984050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:13.044238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226a73-9e44-4df3-b877-8364d44f6013 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.047836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.048479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.048759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.049086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.050921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:13.069427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.069427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.074760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1234/2480] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:13.215983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1247/2481] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:12 2022] POST /identity/v3/users => generated 290 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:13.217326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.227428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74b1a-f1c7-43d7-b7ae-88d045d41b5b service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.232256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.232987 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.233363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.233705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.234526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.236266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.247546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1235/2482] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:13.260395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.271135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e029c0b-7e74-488f-aaa8-2af6a533ea0f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.275923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.276585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.276868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.277180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.277908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.279584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820d3bf-b1c8-4308-b653-3a26749068de admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.290403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1248/2483] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:13.301597 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.311611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51208ae7-d17d-4a3b-873f-5addf0dbfdcc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.316795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.317697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.317979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.318253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] PATH_INFO: `/v3/projects/9ba36380b5984047802df909d4cd9978/users/08276838c72b4ec2bbcbbee3a789957c/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.332904 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba36380b5984047802df909d4cd9978, user_id=08276838c72b4ec2bbcbbee3a789957c, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.338225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.447643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1236/2484] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:13 2022] PUT /identity/v3/projects/9ba36380b5984047802df909d4cd9978/users/08276838c72b4ec2bbcbbee3a789957c/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:13.458393 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.459069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.459399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.494449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] MFA Rules not processed for user `08276838c72b4ec2bbcbbee3a789957c`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:13.495732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:13.574451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1249/2485] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:13.575608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.646781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cacbf2-b09d-4bb5-91a6-0a3152615980 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.651595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.652644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.652644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.652866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.653647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.655913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.767893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1237/2486] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:13 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:13.769975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.782180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253ea20-c50b-4794-87ce-3905c2361e0e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.842639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.843718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.844004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.844283 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.845018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.847095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.952077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1250/2487] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:13 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:13.956334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:13.970274 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28b3b4-e865-4784-ba9b-9c9e7c4c28c7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:13.975574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:13.976281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:13.976720 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:13.976998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:13.977765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:13.979368 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:13.990583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1238/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:13.994783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.005314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63787a-9348-4a08-8452-bd2a3d11446a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.015225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.015903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.016240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.016516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.017481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.019610 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aff778-8c10-478d-9ce5-6ba9fcc85bc2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:14.030865 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1251/2489] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:14.041210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.051499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41256414-79e3-451d-84fe-6d033f9e1f41 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.060718 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.061802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.062091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.062499 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] PATH_INFO: `/v3/projects/021861b900654276b0744c97c0e31dd3/users/0be11f56f869466da7be45bf8d830df1/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.084517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=021861b900654276b0744c97c0e31dd3, user_id=0be11f56f869466da7be45bf8d830df1, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.087262 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:14.236222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1239/2490] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:14 2022] PUT /identity/v3/projects/021861b900654276b0744c97c0e31dd3/users/0be11f56f869466da7be45bf8d830df1/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:14.251300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.251591 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.251868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.308643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] MFA Rules not processed for user `0be11f56f869466da7be45bf8d830df1`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:14.311759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:14.407084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1252/2491] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:14.412634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.491801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be00a1-7cfb-4cb0-bf9f-da73197129ee admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.496638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.497331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.497629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.497891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.498577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.500501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:14.648527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1240/2492] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:14 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:14.652588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.664464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77698aa-24ea-4197-a2a5-742fe16696d6 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.729477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.730272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.730631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.730969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.731747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.733852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:14.834451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1253/2493] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:14 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:14.835891 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.846536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af8e16-aabe-4698-9650-16bca6277a04 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.852972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.853860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.854252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.854631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.855473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.857386 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:14.870197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1241/2494] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:14.874230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:14.886520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e68bbb-31de-4d24-92d1-78b52ac86312 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:14.898356 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:14.899656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:14.900450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:14.901190 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] PATH_INFO: `/v3/projects/f331e724c53f4b84ad893181302cdc5d/users/d49101bcec0244a6864cdfe72c85edd5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:14.923594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f331e724c53f4b84ad893181302cdc5d, user_id=d49101bcec0244a6864cdfe72c85edd5, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:14.928581 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:15.015826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1254/2495] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:14 2022] PUT /identity/v3/projects/f331e724c53f4b84ad893181302cdc5d/users/d49101bcec0244a6864cdfe72c85edd5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:15.017034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:15.028733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56248860-33d7-4161-85dd-bba3f9f32ba0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:15.105357 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:15.106353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:15.106638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:15.106913 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:15.107633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:15.109327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2ca34-11b3-430e-ab28-aba534e51f79 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:15.120302 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1242/2496] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:15.124662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:15.137967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e34b0-1ab5-477a-bbab-8e8b73c81655 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:15.143255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:15.144918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:15.145600 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:15.145983 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] PATH_INFO: `/v3/projects/f331e724c53f4b84ad893181302cdc5d/users/d49101bcec0244a6864cdfe72c85edd5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:15.148271 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f331e724c53f4b84ad893181302cdc5d, user_id=d49101bcec0244a6864cdfe72c85edd5, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:15.151268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:15.163884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1255/2497] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:15 2022] PUT /identity/v3/projects/f331e724c53f4b84ad893181302cdc5d/users/d49101bcec0244a6864cdfe72c85edd5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:15.174230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:15.175012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:15.175342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:15.207856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] MFA Rules not processed for user `d49101bcec0244a6864cdfe72c85edd5`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:15.209705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:15.294971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1243/2498] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:15.306076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:15.309340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:15.373126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea635-06d9-4109-b51b-4a2fa2cc3c87 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:15.377308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:15.377960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:15.378249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:15.378608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:15.388178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:15.389656 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:15.401148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1256/2499] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:15.600400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:15.601971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:15.614928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f9c5-73b2-4fef-81fe-eeb388ba1a2d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:15.620630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:15.620630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:15.620630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:15.620630 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:15.678479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:15.680048 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:15.691613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1244/2500] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:16.802579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:16.864823 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845740c-1e0b-44c6-bcc6-92d2586cd8bb service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:16.868721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:16.869570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:16.869955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:16.870369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:16.872403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:16.945000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:16.946654 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:16.958175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1257/2501] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:17.478162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:17.480203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:17.495926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b4f35-ef31-43b1-9329-52445b23b893 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:17.500592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:17.501644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:17.502002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:17.502353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] PATH_INFO: `/v3/users/e2074c33e19940eba5fc2ac957f5636a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:17.503723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2074c33e19940eba5fc2ac957f5636a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:17.505782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:17.750682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2074c33e19940eba5fc2ac957f5636a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:17.757782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2074c33e19940eba5fc2ac957f5636a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:17.758465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2074c33e19940eba5fc2ac957f5636a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:17.846513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2074c33e19940eba5fc2ac957f5636a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:17.847777 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-927932b8-d2a7-464e-964d-f078d10d23dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2074c33e19940eba5fc2ac957f5636a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:17.868989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1245/2502] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:17 2022] DELETE /identity/v3/users/e2074c33e19940eba5fc2ac957f5636a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:18.150509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:18.170274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287f97d-d11c-4123-aa14-969f2a5567bb service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:18.251314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:18.261621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.263522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.263916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] PATH_INFO: `/v3/projects/71bc6040267d48ae87a84efad9be6fe4` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.270054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bc6040267d48ae87a84efad9be6fe4)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:18.273939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:18.420897 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bc6040267d48ae87a84efad9be6fe4', 'request_id': 'req-82a8be95-f541-40a4-9056-f140d2ef5d6f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:18.427373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bc6040267d48ae87a84efad9be6fe4', 'request_id': 'req-82a8be95-f541-40a4-9056-f140d2ef5d6f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:18.532049 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bc6040267d48ae87a84efad9be6fe4', 'request_id': 'req-82a8be95-f541-40a4-9056-f140d2ef5d6f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:18.544869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] The token cache is being invalidate because project 71bc6040267d48ae87a84efad9be6fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:18.545343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:18.546099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-82a8be95-f541-40a4-9056-f140d2ef5d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:18.547810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1258/2503] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:18 2022] DELETE /identity/v3/projects/71bc6040267d48ae87a84efad9be6fe4 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:18.553882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.554371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.554371 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.572452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:18.573693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:18.639036 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1246/2504] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:18.656543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.656827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.657124 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.693605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:18.694516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:18.703112 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1259/2505] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:18.707464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:18.717319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4be1a-aa44-44e5-9efb-6d1ea4447563 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:18.723197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:18.723952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.724300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.724857 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.725839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:18.726202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:18.728026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:18.741083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1247/2506] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:18.744898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:18.754920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf67bc-1dd4-43b1-ba24-d5a182c7dd18 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:18.759733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:18.760394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.760681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.760957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.761693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:18.763621 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:18.871991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1260/2507] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:18 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:18.875804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:18.886709 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d1fb4-0140-43ea-a7e2-4400eeb63a61 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:18.956240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:18.956961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:18.957282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:18.957561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:18.958249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:18.960181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.069307 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1248/2508] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:18 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:19.070608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.082839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62890b-c80e-459f-9207-03c4d9abee74 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.088175 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.088853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.089287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.090905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.090905 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.092412 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.107995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1261/2509] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:19.111576 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.123198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c539f34-1659-434e-a90a-f62a7f5b96a9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.128054 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.129199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.129443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.129717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.130483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.132061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae290701-00c8-435b-b373-d2c3673afeb0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.142488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1249/2510] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:06:19.151574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.161858 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b643a5d-82e8-4d64-911f-0d9174c1629b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.167069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.168055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.168426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.168770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] PATH_INFO: `/v3/projects/c3feacdcbc2840c6913809eaa302d2af/users/63792367890f411da9a51c83bc3e31a1/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.186869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3feacdcbc2840c6913809eaa302d2af, user_id=63792367890f411da9a51c83bc3e31a1, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.189684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.270609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1262/2511] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:19 2022] PUT /identity/v3/projects/c3feacdcbc2840c6913809eaa302d2af/users/63792367890f411da9a51c83bc3e31a1/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:19.280927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437746-3ffc-4265-922b-712115028e75 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.281159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437746-3ffc-4265-922b-712115028e75 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.281445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63437746-3ffc-4265-922b-712115028e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.316654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-63437746-3ffc-4265-922b-712115028e75 None None] MFA Rules not processed for user `63792367890f411da9a51c83bc3e31a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:19.318098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-63437746-3ffc-4265-922b-712115028e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:19.384013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1250/2512] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:19.388577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.450358 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173623a-de22-47a3-9b69-518dc330cc3e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.456976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.458028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.458405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.458762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.459470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.461458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.596268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1263/2513] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:19 2022] POST /identity/v3/projects => generated 393 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:19.601150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63437746-3ffc-4265-922b-712115028e75 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.617947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63437746-3ffc-4265-922b-712115028e75 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.685462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.686365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.690792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.690792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.690792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.690792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.804688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1251/2514] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:19 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:19.808563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.818714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2e89-2b32-4aa1-ac9e-7b51fa59c6c6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.823272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.835223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.835223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.835223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.835223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.835223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:19.840490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1264/2515] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:19.841833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:19.852578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf658d-a3f2-4f88-8273-105fc75181d2 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:19.857243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:19.858120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:19.858416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:19.858697 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] PATH_INFO: `/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c/users/f9b4478b5de54d07b5c7c8af6a2e2e8a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:19.875006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba6f1c7fa7544b4afd57ca32bf3068c, user_id=f9b4478b5de54d07b5c7c8af6a2e2e8a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:19.877738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.000834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1252/2516] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:19 2022] PUT /identity/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c/users/f9b4478b5de54d07b5c7c8af6a2e2e8a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:20.005634 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.017984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8e772-70fc-4960-a782-0a1998da9791 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.083122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.083799 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.084089 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.084368 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.085183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.086790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0645e8-6b7d-497f-af7e-675c699015e5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.097932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1265/2517] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:20.102203 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.112354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df30bf-38dc-42d8-b68f-8a55aae49ae0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.117787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.118786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.119142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.119493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] PATH_INFO: `/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c/users/f9b4478b5de54d07b5c7c8af6a2e2e8a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.121632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba6f1c7fa7544b4afd57ca32bf3068c, user_id=f9b4478b5de54d07b5c7c8af6a2e2e8a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.124333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.147771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1253/2518] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:20 2022] PUT /identity/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c/users/f9b4478b5de54d07b5c7c8af6a2e2e8a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:20.157617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.158138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.158250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.171767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.176190 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.195196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] MFA Rules not processed for user `f9b4478b5de54d07b5c7c8af6a2e2e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:20.198993 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.299936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672c4d7-ff7b-4ac7-81a0-85be71d5364a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.306683 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.307965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.308230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.308555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] PATH_INFO: `/v3/users/08276838c72b4ec2bbcbbee3a789957c` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.309874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08276838c72b4ec2bbcbbee3a789957c)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.312603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.317885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1266/2519] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:20.329469 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.333929 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.434414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37cb40-50ef-4983-9bcc-7e70f185e2c4 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.438561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.444662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.445527 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.445907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.457699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.459703 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.473196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1267/2520] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:06:20.529198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08276838c72b4ec2bbcbbee3a789957c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:20.533099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.534784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.540540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08276838c72b4ec2bbcbbee3a789957c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:20.541559 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08276838c72b4ec2bbcbbee3a789957c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:20.551756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe94a-8272-4c23-8939-da7b4c785c71 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.557864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.558520 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.558806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.559086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.621026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.622606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12d10e-894c-4fca-b1eb-81e04a55a7a2 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.634804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1268/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:20.637548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08276838c72b4ec2bbcbbee3a789957c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:20.642296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08276838c72b4ec2bbcbbee3a789957c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:20.668146 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1254/2522] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:20 2022] DELETE /identity/v3/users/08276838c72b4ec2bbcbbee3a789957c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:20.673585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.674098 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.674534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.724074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:20.729630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.794778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1269/2523] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:20.808268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:20.809893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:20.873358 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b65f6-92bf-4cac-9e8b-48a8bf2d87c5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:20.879572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:20.880227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:20.880508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:20.880784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:20.890012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:20.891510 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:20.901432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1255/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:21.465231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:21.466718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:21.479484 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030687d-a265-4f51-b477-37ff3f901e78 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:21.484533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:21.485464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:21.485753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:21.491675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] PATH_INFO: `/v3/projects/9ba36380b5984047802df909d4cd9978` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:21.491675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba36380b5984047802df909d4cd9978)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:21.491675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:21.623181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba36380b5984047802df909d4cd9978', 'request_id': 'req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:21.629302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba36380b5984047802df909d4cd9978', 'request_id': 'req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:21.715074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba36380b5984047802df909d4cd9978', 'request_id': 'req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:21.728139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] The token cache is being invalidate because project 9ba36380b5984047802df909d4cd9978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:21.728490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:21.729232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:21.730817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1270/2525] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:21 2022] DELETE /identity/v3/projects/9ba36380b5984047802df909d4cd9978 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:21.734823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:21.744723 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d53e1f-b90e-4656-acda-254a26e66eb7 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:21.804606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:21.805431 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:21.805710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:21.805979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] PATH_INFO: `/v3/users/0be11f56f869466da7be45bf8d830df1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:21.807205 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be11f56f869466da7be45bf8d830df1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:21.809174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:22.032479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be11f56f869466da7be45bf8d830df1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:22.041321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be11f56f869466da7be45bf8d830df1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:22.042076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be11f56f869466da7be45bf8d830df1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:22.160798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be11f56f869466da7be45bf8d830df1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:22.161586 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be11f56f869466da7be45bf8d830df1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:22.181271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1256/2526] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:21 2022] DELETE /identity/v3/users/0be11f56f869466da7be45bf8d830df1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:22.774886 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:22.776403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:22.790789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413ce8-88ba-403a-9a7e-9ac9318ddcac admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:22.866404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:22.867522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:22.867990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:22.886766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] PATH_INFO: `/v3/projects/021861b900654276b0744c97c0e31dd3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:22.889735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=021861b900654276b0744c97c0e31dd3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:22.891834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:23.053834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021861b900654276b0744c97c0e31dd3', 'request_id': 'req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.060074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021861b900654276b0744c97c0e31dd3', 'request_id': 'req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.143355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021861b900654276b0744c97c0e31dd3', 'request_id': 'req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.157211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] The token cache is being invalidate because project 021861b900654276b0744c97c0e31dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:23.157857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.158584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.160911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1271/2527] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:22 2022] DELETE /identity/v3/projects/021861b900654276b0744c97c0e31dd3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:23.166097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:23.167573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:23.182276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839db28-8552-4df7-a36a-a2278a497728 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:23.238550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:23.239323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:23.239608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:23.239880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] PATH_INFO: `/v3/users/d49101bcec0244a6864cdfe72c85edd5` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:23.241101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49101bcec0244a6864cdfe72c85edd5)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:23.243038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:23.531682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49101bcec0244a6864cdfe72c85edd5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.540560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49101bcec0244a6864cdfe72c85edd5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.541549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49101bcec0244a6864cdfe72c85edd5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.658544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49101bcec0244a6864cdfe72c85edd5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.659380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-558b3b7e-c7e9-4865-a238-18852169984b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49101bcec0244a6864cdfe72c85edd5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:23.693286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1257/2528] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:23 2022] DELETE /identity/v3/users/d49101bcec0244a6864cdfe72c85edd5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:24.209215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:24.211164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:24.224824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870d4d6-6132-4c20-bc20-dd2aa0bae5f0 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:24.302536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:24.303431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:24.303743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:24.304019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] PATH_INFO: `/v3/projects/f331e724c53f4b84ad893181302cdc5d` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:24.305366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f331e724c53f4b84ad893181302cdc5d)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:24.307867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:24.526242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f331e724c53f4b84ad893181302cdc5d', 'request_id': 'req-8e389fac-6a0a-48f6-a606-a948ac6f287c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:24.533203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f331e724c53f4b84ad893181302cdc5d', 'request_id': 'req-8e389fac-6a0a-48f6-a606-a948ac6f287c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:24.628732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f331e724c53f4b84ad893181302cdc5d', 'request_id': 'req-8e389fac-6a0a-48f6-a606-a948ac6f287c'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:24.641055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] The token cache is being invalidate because project f331e724c53f4b84ad893181302cdc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:24.641387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:24.642046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-8e389fac-6a0a-48f6-a606-a948ac6f287c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:24.643697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1272/2529] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:24 2022] DELETE /identity/v3/projects/f331e724c53f4b84ad893181302cdc5d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:24.650583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:24.651065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:24.651164 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:24.668862 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:24.670150 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:24.729792 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1258/2530] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:24.738816 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:24.739110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:24.739421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:24.758298 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:24.759560 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:24.768564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1273/2531] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:24.773261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:24.782886 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c15bc-3251-4f33-b268-0a8274bcd9c6 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:24.788484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:24.789197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:24.789480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:24.789756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:24.790489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:24.790889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:24.792438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:24.805145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1259/2532] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:06:24.809427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:24.819386 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320e6a8-9f7d-47d4-adec-f8a16ab31b6c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:24.844724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:24.845382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:24.845696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:24.845944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:24.846658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:24.849141 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:24.948577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1274/2533] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:24 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:24.950056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:24.961396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa855a-ea58-4acf-9c4e-84362b0842f0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.021543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.022227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.022516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.022842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.023535 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.025619 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:25.117711 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1260/2534] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:24 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:25.122871 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:25.140222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c9fc-45e2-4bad-95c6-2fda543e71e8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.147373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.148980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.149328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.149586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.150323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.152003 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:25.170580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1275/2535] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:06:25.177345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:25.190283 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e5673-a183-44cb-87b4-a06d3e3327d5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.197325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.198581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.199209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.199647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.200567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.202595 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfb9dc-c5c4-4fa6-82e9-67f101759a08 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:25.218782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1261/2536] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:25.219620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:25.234622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557c1cb-1ae3-42cf-a5d5-1287f2684f7f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.255785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.256769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.257080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.257353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] PATH_INFO: `/v3/projects/a7f6d9b7b15946b1ab2cb8912da86268/users/66b598ac97f547c1949986d6320a9c3c/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.274766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f6d9b7b15946b1ab2cb8912da86268, user_id=66b598ac97f547c1949986d6320a9c3c, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.281050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:25.395577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1276/2537] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:25 2022] PUT /identity/v3/projects/a7f6d9b7b15946b1ab2cb8912da86268/users/66b598ac97f547c1949986d6320a9c3c/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:25.400840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.401202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.401487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.422091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:25.423527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:25.483836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1262/2538] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:25.494869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:25.496693 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:25.566433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449696f9-595d-4294-82f7-c563ce4db7ba admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.570800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.571461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.571752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.572091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.586361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.588149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:25.603147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1277/2539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:25.950482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:25.952027 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:25.964689 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feee788-8200-4980-bdcc-194f3ff641f5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:25.969462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:25.970343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:25.970807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:25.971253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] PATH_INFO: `/v3/users/1f621fd74b5e4b40968d0eb08306e3ff` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:25.973195 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f621fd74b5e4b40968d0eb08306e3ff)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:25.975305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:26.003543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:26.005394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:26.018869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c767ed7-4358-463d-841b-84848922c897 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:26.024290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:26.025259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:26.025747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:26.026028 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] PATH_INFO: `/v3/users/63792367890f411da9a51c83bc3e31a1` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:26.027237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63792367890f411da9a51c83bc3e31a1)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:26.029213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:26.232323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f621fd74b5e4b40968d0eb08306e3ff'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.232579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63792367890f411da9a51c83bc3e31a1'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.233582 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63792367890f411da9a51c83bc3e31a1'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.240243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f621fd74b5e4b40968d0eb08306e3ff'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.240934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f621fd74b5e4b40968d0eb08306e3ff'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.241470 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63792367890f411da9a51c83bc3e31a1'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.360561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f621fd74b5e4b40968d0eb08306e3ff'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.361156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d4a7ed7a-74fe-4b95-8f71-d2ed7c2a74a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f621fd74b5e4b40968d0eb08306e3ff'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.379208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1263/2540] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:25 2022] DELETE /identity/v3/users/1f621fd74b5e4b40968d0eb08306e3ff => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:26.455447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63792367890f411da9a51c83bc3e31a1'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.455447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63792367890f411da9a51c83bc3e31a1'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.468705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1278/2541] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:26 2022] DELETE /identity/v3/users/63792367890f411da9a51c83bc3e31a1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:26.474415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:26.474865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:26.475273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:26.495432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:26.496814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:26.564832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1264/2542] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:26.574863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:26.576331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:26.633428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7fe08-b482-4d13-b6dd-cf91dc13b2cc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:26.636978 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:26.637641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:26.637923 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:26.638194 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:26.647930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:26.649455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:26.658606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1279/2543] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:26.679982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:26.680292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:26.694263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885a49-d9b8-4465-8d19-53695ac13534 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:26.699227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:26.700186 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:26.700474 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:26.700750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] PATH_INFO: `/v3/projects/f1ee5963c6d44378ace94ad0ff7152f1` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:26.703531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ee5963c6d44378ace94ad0ff7152f1)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:26.731647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:26.823162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ee5963c6d44378ace94ad0ff7152f1', 'request_id': 'req-47b98296-478e-43e8-92f1-e32c1af21068'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.828299 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ee5963c6d44378ace94ad0ff7152f1', 'request_id': 'req-47b98296-478e-43e8-92f1-e32c1af21068'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.904712 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ee5963c6d44378ace94ad0ff7152f1', 'request_id': 'req-47b98296-478e-43e8-92f1-e32c1af21068'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.916927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] The token cache is being invalidate because project f1ee5963c6d44378ace94ad0ff7152f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:26.917247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.917828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:26.920322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1265/2544] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:26 2022] DELETE /identity/v3/projects/f1ee5963c6d44378ace94ad0ff7152f1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:26.923721 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:26.933753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed124-6aa8-40ad-b7c8-adab15790cce service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:26.991155 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:26.992030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:26.992319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:26.992603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] PATH_INFO: `/v3/users/4c5fe25308d34a4091c1d30d120d506e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:26.993943 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5fe25308d34a4091c1d30d120d506e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:26.995875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:27.160352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:27.160352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:27.171183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b98296-478e-43e8-92f1-e32c1af21068 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:27.176516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:27.177422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:27.177706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:27.177986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] PATH_INFO: `/v3/projects/c3feacdcbc2840c6913809eaa302d2af` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:27.179200 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3feacdcbc2840c6913809eaa302d2af)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:27.181161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:27.243156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5fe25308d34a4091c1d30d120d506e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.243815 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5fe25308d34a4091c1d30d120d506e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.250550 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5fe25308d34a4091c1d30d120d506e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.332427 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3feacdcbc2840c6913809eaa302d2af', 'request_id': 'req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.337613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3feacdcbc2840c6913809eaa302d2af', 'request_id': 'req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.349026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5fe25308d34a4091c1d30d120d506e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.350020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-6549207a-bebf-4271-8b6a-49515115173c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5fe25308d34a4091c1d30d120d506e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.367726 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1280/2545] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:26 2022] DELETE /identity/v3/users/4c5fe25308d34a4091c1d30d120d506e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:27.369066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:27.369375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:27.369652 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:27.396465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] MFA Rules not processed for user `66b598ac97f547c1949986d6320a9c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:27.397725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:27.462831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1281/2546] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:27.467359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:27.468925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:27.508177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3feacdcbc2840c6913809eaa302d2af', 'request_id': 'req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.517103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] The token cache is being invalidate because project c3feacdcbc2840c6913809eaa302d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:27.517561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.518397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.520622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1266/2547] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:27 2022] DELETE /identity/v3/projects/c3feacdcbc2840c6913809eaa302d2af => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:27.524880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:27.526573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:27.542315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b482820-826d-4956-b907-c05ec6049f02 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:27.546938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:27.547590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:27.547875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:27.548145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:27.548828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:27.551662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:27.590899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf7a16-0cf5-4f4c-a6ae-f38cb657869a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:27.595610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:27.596481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:27.597324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:27.597596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] PATH_INFO: `/v3/users/f9b4478b5de54d07b5c7c8af6a2e2e8a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:27.598982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b4478b5de54d07b5c7c8af6a2e2e8a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:27.600700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:27.670350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1282/2548] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:27 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:27.671291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:27.672915 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:27.741518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890a093-569d-407e-bb3f-a046632d7466 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:27.746204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:27.747094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:27.747417 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:27.747780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] PATH_INFO: `/v3/projects/63375812ccc54a88a4dadbb314c39d74` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:27.749052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63375812ccc54a88a4dadbb314c39d74)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:27.750974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:27.813414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b4478b5de54d07b5c7c8af6a2e2e8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.820103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b4478b5de54d07b5c7c8af6a2e2e8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.820771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b4478b5de54d07b5c7c8af6a2e2e8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.920117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63375812ccc54a88a4dadbb314c39d74', 'request_id': 'req-3e0e1a3a-0381-4775-acee-56aa54141bc8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.925545 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63375812ccc54a88a4dadbb314c39d74', 'request_id': 'req-3e0e1a3a-0381-4775-acee-56aa54141bc8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.926447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b4478b5de54d07b5c7c8af6a2e2e8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.927063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b4478b5de54d07b5c7c8af6a2e2e8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:27.944567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1267/2549] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:27 2022] DELETE /identity/v3/users/f9b4478b5de54d07b5c7c8af6a2e2e8a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:27.945388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:27.946706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:28.010795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab30c3-f358-4a91-b215-7b4253e0d37e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.015484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.016210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.016435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.016713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.017432 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.018406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63375812ccc54a88a4dadbb314c39d74', 'request_id': 'req-3e0e1a3a-0381-4775-acee-56aa54141bc8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.021757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.032901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] The token cache is being invalidate because project 63375812ccc54a88a4dadbb314c39d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:28.033426 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.034237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.036467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1283/2550] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:27 2022] DELETE /identity/v3/projects/63375812ccc54a88a4dadbb314c39d74 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:28.115983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1268/2551] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:27 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:28.120265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.121959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:28.195212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1a3a-0381-4775-acee-56aa54141bc8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.203555 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.204259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.204578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.204980 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.205792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.208308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.219513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1284/2552] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:28.225078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.240098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d02a0-4f51-47df-bda6-a161639f4119 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.245007 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.245980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.246269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.246554 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] PATH_INFO: `/v3/projects/349053d5688a44fcaff48d22f4f6f755/users/95a4a35856224edaa339da912153b0d5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.263238 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=349053d5688a44fcaff48d22f4f6f755, user_id=95a4a35856224edaa339da912153b0d5, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.270184 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.355433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1269/2553] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:28 2022] PUT /identity/v3/projects/349053d5688a44fcaff48d22f4f6f755/users/95a4a35856224edaa339da912153b0d5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:28.359607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.369737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911db5bd-d78e-49b9-be7c-f7480a57f108 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.424658 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.425373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.425662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.425944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.426723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.428321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.437854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1285/2554] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:28.442295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.452649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d55d-b86e-4ac8-aada-6a0506a02e99 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.457935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.458848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.459120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.459591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] PATH_INFO: `/v3/projects/349053d5688a44fcaff48d22f4f6f755/users/95a4a35856224edaa339da912153b0d5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.461622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=349053d5688a44fcaff48d22f4f6f755, user_id=95a4a35856224edaa339da912153b0d5, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.464250 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b8a1-547f-4db7-b0b0-0e55b699fc2e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.475253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1270/2555] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:28 2022] PUT /identity/v3/projects/349053d5688a44fcaff48d22f4f6f755/users/95a4a35856224edaa339da912153b0d5/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:28.508235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.509988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:28.523868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f24db5-ea51-45a8-8fc0-e356e94b1e14 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.578219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.579076 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.579355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.579624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] PATH_INFO: `/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.580812 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba6f1c7fa7544b4afd57ca32bf3068c)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.583465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.714798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba6f1c7fa7544b4afd57ca32bf3068c', 'request_id': 'req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.720122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba6f1c7fa7544b4afd57ca32bf3068c', 'request_id': 'req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.804960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba6f1c7fa7544b4afd57ca32bf3068c', 'request_id': 'req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.817802 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] The token cache is being invalidate because project eba6f1c7fa7544b4afd57ca32bf3068c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:28.818097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.818765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ebf6b9a7-f469-4532-a0d2-df7bb4a1dbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:28.820861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1286/2556] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:28 2022] DELETE /identity/v3/projects/eba6f1c7fa7544b4afd57ca32bf3068c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:28.825670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.825963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.826241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.844958 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:28.846187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:28.903394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1271/2557] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:28.913119 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.913418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.913700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.932416 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:28.933630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:28.942273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1287/2558] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:28.950087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.959738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8d2ad-8c51-4d7a-942b-d9d9536313b7 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.964387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:28.965111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:28.965402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:28.965680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:28.966405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:28.966714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:28.968318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:28.981366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1272/2559] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:28.984854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:28.995145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998e22-74b4-46b3-b118-7ba84235f3e7 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:28.999919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.000577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.000864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.001178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.001885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.004379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.114528 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1288/2560] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:28 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:29.115983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.125895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a5a72-a2fb-4178-b874-56f7a8bb46dc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.182739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.183352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.183633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.183906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.184611 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.187144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.297502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1273/2561] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:29 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:29.303127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.313239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82833-c3a6-4bb8-8a84-db56fff56bb0 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.318125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.318808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.319096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.319425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.320172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.321837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.332429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1289/2562] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:29.336385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.346572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9651d5f-7664-40cf-95ec-e39369541740 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.352279 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.352931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.353243 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.353520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.354239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.355868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7d54-365f-4c21-9543-68e937779641 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.366966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1274/2563] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:29.371134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.381529 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017541a-2b1a-429d-bcac-7422e087a537 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.386264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.387137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.387419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.387691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] PATH_INFO: `/v3/projects/45e62c840ffb471eaee492aa1f0d5388/users/c41ca48f64314e21a7659bb62ea74526/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.402542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e62c840ffb471eaee492aa1f0d5388, user_id=c41ca48f64314e21a7659bb62ea74526, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.405213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.504800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1290/2564] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:29 2022] PUT /identity/v3/projects/45e62c840ffb471eaee492aa1f0d5388/users/c41ca48f64314e21a7659bb62ea74526/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:29.515342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.515639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.515931 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.552142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] MFA Rules not processed for user `c41ca48f64314e21a7659bb62ea74526`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:29.553963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:29.618612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1275/2565] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:29.623216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.684404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6794790-16d0-4478-9d9b-fb44cc159791 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.689001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.689766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.690069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.690424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.691608 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.693502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e406e7d-f045-4383-a80d-9fdeeefd333a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.822199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1291/2566] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:29 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:29.823436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.836113 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441471ad-eddd-4912-8c64-6dfde704b2b1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:29.870390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.870757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.871121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.900661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:29.901553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:29.902241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:29.902241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:29.903013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:29.905086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:29.905231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] MFA Rules not processed for user `95a4a35856224edaa339da912153b0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:29.906524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:29.976819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1292/2567] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:29.984783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1276/2568] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:29 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:29.989019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.992795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:29.994789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:29.999198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46c5e7-56d4-4f1e-b176-c4f88bf1550b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.005639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.006706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.007001 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.007309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.008044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.009717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.024330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1293/2569] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:30.025375 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:30.034704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f52e0b-8e67-4803-947e-2d40941c303c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.039373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.040256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.040543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.040821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] PATH_INFO: `/v3/projects/357d869296854eb3ba419c1ccf523523/users/36626120078d4353b573bf18a66a7f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.052655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac349945-733e-4263-b9f9-9ce1bccd240f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.055807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=357d869296854eb3ba419c1ccf523523, user_id=36626120078d4353b573bf18a66a7f45, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.056206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.056848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.057157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.057429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.058544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.059183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:30.117327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.118768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.127469 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1277/2570] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:06:30.160891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1294/2571] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:30 2022] PUT /identity/v3/projects/357d869296854eb3ba419c1ccf523523/users/36626120078d4353b573bf18a66a7f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:30.165032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:30.176211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542f46c-bcba-4ce3-80e5-3cece19f72d0 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.232934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.233561 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.233842 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.234116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.234832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.236429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a22cff-8d25-4f5c-936b-dedf0b61d28c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.249813 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1278/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:06:30.251235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:30.263135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6818-0e04-4363-9939-66cce699dd5a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.267262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.268187 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.268506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.269402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] PATH_INFO: `/v3/projects/357d869296854eb3ba419c1ccf523523/users/36626120078d4353b573bf18a66a7f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.271613 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=357d869296854eb3ba419c1ccf523523, user_id=36626120078d4353b573bf18a66a7f45, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.274352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.284421 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1295/2573] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:30 2022] PUT /identity/v3/projects/357d869296854eb3ba419c1ccf523523/users/36626120078d4353b573bf18a66a7f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:30.295560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.297216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.297216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.322740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] MFA Rules not processed for user `36626120078d4353b573bf18a66a7f45`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:30.323941 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:30.390388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1279/2574] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:30.402745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:30.404446 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:30.460890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08674f-67d0-4c82-a345-8070d2d2e1dc admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:30.464684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:30.465359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:30.465688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:30.465966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:30.476820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:30.476820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8e1ae-e772-4311-b1ad-12297921f586 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:30.486284 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1296/2575] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:31.061103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:31.123376 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e856fb9a-9a18-47f0-8a6f-6b5b0e96e72d None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:31.127934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:31.129477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:31.129758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:31.130032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] PATH_INFO: `/v3/users/c41ca48f64314e21a7659bb62ea74526` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:31.131259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41ca48f64314e21a7659bb62ea74526)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:31.133219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:31.293525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41ca48f64314e21a7659bb62ea74526'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:31.300783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41ca48f64314e21a7659bb62ea74526'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:31.301790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41ca48f64314e21a7659bb62ea74526'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:31.388818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41ca48f64314e21a7659bb62ea74526'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:31.389493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41ca48f64314e21a7659bb62ea74526'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:31.407344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1280/2576] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:31 2022] DELETE /identity/v3/users/c41ca48f64314e21a7659bb62ea74526 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:31.412463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:31.412928 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:31.413027 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:31.430350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:31.431577 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:31.487893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1297/2577] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:31.497522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:31.498965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:31.556014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968506de-1c1a-4dd1-88a9-a4bf4060cd7b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:31.559646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:31.563710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:31.563710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:31.563710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:31.570298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:31.571724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:31.581059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1281/2578] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:31.979032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:31.982856 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:31.993340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cab91-bf6b-4f01-85ff-c2a6d49e1dfd None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:31.998020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:31.999000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:31.999162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:31.999440 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] PATH_INFO: `/v3/projects/45e62c840ffb471eaee492aa1f0d5388` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:32.000904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e62c840ffb471eaee492aa1f0d5388)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:32.002904 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:32.033223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:32.034722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:32.089834 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4a543-f71b-4c72-87dc-bae386ba151b service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:32.093547 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:32.094187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:32.094468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:32.094741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:32.096550 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:32.120203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e62c840ffb471eaee492aa1f0d5388', 'request_id': 'req-92b160d5-e9f0-4829-b5f4-31509ec87e71'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.125588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e62c840ffb471eaee492aa1f0d5388', 'request_id': 'req-92b160d5-e9f0-4829-b5f4-31509ec87e71'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.158336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:32.160613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:32.170464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1282/2579] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:06:32.223780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e62c840ffb471eaee492aa1f0d5388', 'request_id': 'req-92b160d5-e9f0-4829-b5f4-31509ec87e71'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.235039 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] The token cache is being invalidate because project 45e62c840ffb471eaee492aa1f0d5388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:32.235326 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.235936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.237713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1298/2580] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:31 2022] DELETE /identity/v3/projects/45e62c840ffb471eaee492aa1f0d5388 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:32.241688 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:32.251762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36517-5882-44bf-be85-041ad8d834b1 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:32.308379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:32.309424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:32.309708 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:32.309980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] PATH_INFO: `/v3/users/36626120078d4353b573bf18a66a7f45` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:32.311167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36626120078d4353b573bf18a66a7f45)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:32.313287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:32.556229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36626120078d4353b573bf18a66a7f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.562761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36626120078d4353b573bf18a66a7f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.563413 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36626120078d4353b573bf18a66a7f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.675131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36626120078d4353b573bf18a66a7f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.675801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f9ac0521-965a-4e70-a2a6-8462736f4364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36626120078d4353b573bf18a66a7f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:32.694610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1283/2581] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:32 2022] DELETE /identity/v3/users/36626120078d4353b573bf18a66a7f45 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:33.145699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:33.147265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:33.160091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b160d5-e9f0-4829-b5f4-31509ec87e71 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:33.216069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:33.217000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.217323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.217601 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] PATH_INFO: `/v3/projects/357d869296854eb3ba419c1ccf523523` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.218792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=357d869296854eb3ba419c1ccf523523)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:33.220916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:33.365395 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357d869296854eb3ba419c1ccf523523', 'request_id': 'req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:33.370696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357d869296854eb3ba419c1ccf523523', 'request_id': 'req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:33.508617 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357d869296854eb3ba419c1ccf523523', 'request_id': 'req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:33.520690 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] The token cache is being invalidate because project 357d869296854eb3ba419c1ccf523523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:33.520977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:33.521643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-db3c31af-a33a-4c5f-900b-b344cdbb0b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:33.523178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1299/2582] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:33 2022] DELETE /identity/v3/projects/357d869296854eb3ba419c1ccf523523 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:06:33.527993 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.528312 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.528592 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.546379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:33.547600 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:33.619205 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1284/2583] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:33.630633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.630922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.631230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.651704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:33.662126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:33.675785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1300/2584] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:33.681664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:33.692011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ff4f-7bfd-41f7-a6fb-32aa0dce1e10 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:33.697176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:33.697882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.698168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.698443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.699175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:33.699483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:33.701148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:33.718105 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1285/2585] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:33.722824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:33.732437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa5a39-4609-4359-9bf5-6e5e49915f48 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:33.737863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:33.738704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.738994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.739272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.739958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:33.741893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:33.921622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1301/2586] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:33 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:33.926303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:33.936287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214cf4-ae6a-4035-8d8e-b242e2e771ef admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:33.996972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:33.997682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:33.997972 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:33.998281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:33.998989 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.000961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.114795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1286/2587] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:33 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:34.118935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.129472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d6a71-45f1-4e1b-8a57-0ec5f489c989 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.134118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.134770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.135056 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.135333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.136102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.137828 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.149153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1302/2588] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:34.153005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.163126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5ea9b-fb64-41d6-81e4-8b9c3a1ff576 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.167590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.168237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.168520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.168794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.169549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.171129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df5e66-d44e-4cc5-a0ca-a9f4dc30bd3e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.182628 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1287/2589] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:34.185977 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.196964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be437e-9242-49b9-8d26-626054082773 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.201612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.202489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.202806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.203083 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] PATH_INFO: `/v3/projects/dbd983f3975b4bd29363980aa92ec5ae/users/1ec84b3c64ac44118965b948e3d772b5/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.217330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd983f3975b4bd29363980aa92ec5ae, user_id=1ec84b3c64ac44118965b948e3d772b5, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.219961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.338156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1303/2590] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:34 2022] PUT /identity/v3/projects/dbd983f3975b4bd29363980aa92ec5ae/users/1ec84b3c64ac44118965b948e3d772b5/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:34.349349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.349656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.349942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.376090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] MFA Rules not processed for user `1ec84b3c64ac44118965b948e3d772b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:34.377359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:34.439361 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1288/2591] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:34.444408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.507509 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e593932-3643-4e82-96a7-ec0e5c2b3c16 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.512359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.513032 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.513355 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.513639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.514346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.516263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.630922 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1304/2592] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:34 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:34.634982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.646025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b05d-18a5-48b9-9d8e-ecc9a81b2b24 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.701260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.701954 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.702239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.702517 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.703231 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.705181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.795180 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1289/2593] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:34 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:34.798990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.810240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bdf35-0545-4ab4-ad44-2467a90f48c1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.814873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.815771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.816069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.816343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.817109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.818717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.829229 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1305/2594] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:34.833229 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.843793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53e4a-bbdd-418d-9d82-35e418293d5f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:34.849412 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:34.850298 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:34.850580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:34.850880 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] PATH_INFO: `/v3/projects/8ea856efd4744384a6b5e84e738e536e/users/f318e2e1c5d74fb59f479ddf45a9ff3a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:34.865845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea856efd4744384a6b5e84e738e536e, user_id=f318e2e1c5d74fb59f479ddf45a9ff3a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:34.868558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:34.954506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1290/2595] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:34 2022] PUT /identity/v3/projects/8ea856efd4744384a6b5e84e738e536e/users/f318e2e1c5d74fb59f479ddf45a9ff3a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:34.958878 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:34.968944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3474-743c-4cb4-ae0c-82cd1d16a133 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:35.027488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:35.028162 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:35.028447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:35.028722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:35.029476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:35.031057 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1c227-5c45-44c2-89a7-98d569dcf8ca admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:35.041292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1306/2596] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:06:35.045350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:35.056035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7a5dd-a347-4a32-8fb8-cc446539bb88 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:35.060515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:35.061421 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:35.061704 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:35.061979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] PATH_INFO: `/v3/projects/8ea856efd4744384a6b5e84e738e536e/users/f318e2e1c5d74fb59f479ddf45a9ff3a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:35.064097 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea856efd4744384a6b5e84e738e536e, user_id=f318e2e1c5d74fb59f479ddf45a9ff3a, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:35.067527 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:35.077483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1291/2597] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:35 2022] PUT /identity/v3/projects/8ea856efd4744384a6b5e84e738e536e/users/f318e2e1c5d74fb59f479ddf45a9ff3a/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:35.090853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:35.091144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:35.091427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:35.117409 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] MFA Rules not processed for user `f318e2e1c5d74fb59f479ddf45a9ff3a`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:35.128034 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:35.185564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1307/2598] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:35.198199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:35.199922 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:35.255285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d232e24-44f3-402f-984f-26727b9a7c8d admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:35.258983 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:35.259626 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:35.259910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:35.260187 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:35.270006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:35.271681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:35.282750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1292/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:35.489549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:35.490973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:35.502609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ff487-a2de-42d0-a60b-3ba19adf2fec None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:35.506890 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:35.507476 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:35.507765 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:35.508047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:35.564071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:35.566058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bd728-079a-4065-a486-c0e0f776498a service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:35.575325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1308/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:36.190801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:36.253622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9ce2a-1301-4569-9e1a-75e725e90752 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:36.258348 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:36.259335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:36.259623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:36.259905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] PATH_INFO: `/v3/users/1ec84b3c64ac44118965b948e3d772b5` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:36.261112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec84b3c64ac44118965b948e3d772b5)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:36.263134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:36.497914 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec84b3c64ac44118965b948e3d772b5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:36.504502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec84b3c64ac44118965b948e3d772b5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:36.505365 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec84b3c64ac44118965b948e3d772b5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:36.576316 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec84b3c64ac44118965b948e3d772b5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:36.577228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec84b3c64ac44118965b948e3d772b5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:36.598182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1293/2601] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:36 2022] DELETE /identity/v3/users/1ec84b3c64ac44118965b948e3d772b5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:36.603294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:36.603793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:36.603967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:36.620596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:36.621835 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:36.680390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1309/2602] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:36.690142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:36.692424 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:36.749406 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997fc3-d20e-42af-8b62-c5b8ac299266 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:36.753022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:36.753694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:36.754528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:36.754858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:36.764379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:36.765952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:36.776757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1294/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:37.224543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:37.225981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:37.241466 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202a087-b0d8-41af-9ca3-fe361bc9bd16 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:37.246515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:37.247596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:37.248156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:37.248351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] PATH_INFO: `/v3/projects/dbd983f3975b4bd29363980aa92ec5ae` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:37.249657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd983f3975b4bd29363980aa92ec5ae)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:37.251583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:37.378205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd983f3975b4bd29363980aa92ec5ae', 'request_id': 'req-e704ffaf-48ad-4f2a-82ff-858680bbfe14'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.384439 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd983f3975b4bd29363980aa92ec5ae', 'request_id': 'req-e704ffaf-48ad-4f2a-82ff-858680bbfe14'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.526300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd983f3975b4bd29363980aa92ec5ae', 'request_id': 'req-e704ffaf-48ad-4f2a-82ff-858680bbfe14'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.540269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] The token cache is being invalidate because project dbd983f3975b4bd29363980aa92ec5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:37.541091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.541773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.543334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1310/2604] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:37 2022] DELETE /identity/v3/projects/dbd983f3975b4bd29363980aa92ec5ae => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:37.548267 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:37.561716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71cef-e379-4c1b-8cff-ad6656b6bd85 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:37.621075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:37.621980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:37.622556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:37.622835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] PATH_INFO: `/v3/users/f318e2e1c5d74fb59f479ddf45a9ff3a` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:37.624002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f318e2e1c5d74fb59f479ddf45a9ff3a)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:37.625940 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:37.854986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f318e2e1c5d74fb59f479ddf45a9ff3a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.861612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f318e2e1c5d74fb59f479ddf45a9ff3a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.862284 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f318e2e1c5d74fb59f479ddf45a9ff3a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.977129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f318e2e1c5d74fb59f479ddf45a9ff3a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.977744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a94d74da-1a14-464f-9dc0-461bf178f58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f318e2e1c5d74fb59f479ddf45a9ff3a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:37.994731 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1295/2605] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:37 2022] DELETE /identity/v3/users/f318e2e1c5d74fb59f479ddf45a9ff3a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:38.407537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:38.409015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:38.424781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704ffaf-48ad-4f2a-82ff-858680bbfe14 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:38.480934 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:38.481817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:38.482099 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:38.482376 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] PATH_INFO: `/v3/projects/8ea856efd4744384a6b5e84e738e536e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:38.483542 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea856efd4744384a6b5e84e738e536e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:38.485515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:38.647991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea856efd4744384a6b5e84e738e536e', 'request_id': 'req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:38.653877 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea856efd4744384a6b5e84e738e536e', 'request_id': 'req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:38.737496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea856efd4744384a6b5e84e738e536e', 'request_id': 'req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:38.749783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] The token cache is being invalidate because project 8ea856efd4744384a6b5e84e738e536e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:38.750073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:38.750700 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-45478ac9-a087-4257-a4fc-4fba7f1e8e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:38.752243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1311/2606] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:38 2022] DELETE /identity/v3/projects/8ea856efd4744384a6b5e84e738e536e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:38.757961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:38.758415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:38.758544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:38.776052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:38.777334 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:38.837719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1296/2607] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:38.845457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:38.845749 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:38.846029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:38.866075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:38.867331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:38.875860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1312/2608] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:38.880485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:38.890327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac945769-1d17-42a9-bf9f-6ce44643c0b1 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:38.896649 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:38.897356 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:38.897645 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:38.897924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:38.898653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:38.898961 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:38.900577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:38.919042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1297/2609] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:38.919253 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:38.927477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470970d-2794-4e97-8444-37a9f3807ea9 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:38.932497 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:38.933290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:38.933579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:38.933853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:38.934552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:38.936511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.122223 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1313/2610] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:38 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:39.126433 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.136990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505e028-63f2-4b57-bde0-f1d179841990 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.196821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.197528 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.197819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.198098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.198795 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.200713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.303009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1298/2611] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:39 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:39.307182 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.318174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2be62-edfe-4c0d-b3b7-755a310c8476 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.323117 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.323780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.324071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.324352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.325290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.326955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.338156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1314/2612] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:39.342045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.352086 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d567-8b39-4a7f-a6b4-46fbf7091c22 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.356700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.357373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.357669 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.357950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.358674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.360273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362453ba-6dec-487d-9656-330b44fd9047 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.371171 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1299/2613] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:39.375225 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.385955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd91d10-637b-4736-a670-88643d942986 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.390590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.393070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.393070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.393070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] PATH_INFO: `/v3/projects/17390a374ed84d319929f3e023d12401/users/796c07a5ce9a4bb491c763d3f93c66e7/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.407952 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17390a374ed84d319929f3e023d12401, user_id=796c07a5ce9a4bb491c763d3f93c66e7, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.411166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.526884 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1315/2614] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:39 2022] PUT /identity/v3/projects/17390a374ed84d319929f3e023d12401/users/796c07a5ce9a4bb491c763d3f93c66e7/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:39.538533 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.538830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.539115 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.566257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] MFA Rules not processed for user `796c07a5ce9a4bb491c763d3f93c66e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:39.568148 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:39.631710 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1300/2615] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:39.643060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.644849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:39.701068 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3cf18-d1bb-42d7-acd6-13bc452ede01 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.704772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.705454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.705745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.706019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.714504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.716023 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2563166-10f9-4bb1-9393-75e94fc12def service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:39.725891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1316/2616] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:39.745581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:39.808870 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bb901-17d0-44d1-bd8e-87cb7ef537fe None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:39.813652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:39.817232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:39.817232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:39.817232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] PATH_INFO: `/v3/users/796c07a5ce9a4bb491c763d3f93c66e7` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:39.817654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=796c07a5ce9a4bb491c763d3f93c66e7)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:39.820042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:40.002114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '796c07a5ce9a4bb491c763d3f93c66e7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.009310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '796c07a5ce9a4bb491c763d3f93c66e7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.009980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '796c07a5ce9a4bb491c763d3f93c66e7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.125662 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '796c07a5ce9a4bb491c763d3f93c66e7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.126331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '796c07a5ce9a4bb491c763d3f93c66e7'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.144399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1301/2617] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:39 2022] DELETE /identity/v3/users/796c07a5ce9a4bb491c763d3f93c66e7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:40.149837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:40.150129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:40.150407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:40.167881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:40.169106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:40.227152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1317/2618] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:40.236232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:40.237664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:40.296327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258111c9-b84f-4482-8f4d-e203425554d5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:40.302359 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:40.303444 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:40.303916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:40.304388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:40.316076 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:40.317609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaeecbc-e816-4c8e-b1dd-90677fc67cf6 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:40.330633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1302/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:40.773209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:40.774781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:40.787925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13bc22-ae5a-417a-9cc1-7eb21e4fe8e3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:40.792595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:40.799248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:40.799248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:40.799248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] PATH_INFO: `/v3/projects/17390a374ed84d319929f3e023d12401` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:40.799248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17390a374ed84d319929f3e023d12401)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:40.799248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:40.926780 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17390a374ed84d319929f3e023d12401', 'request_id': 'req-806d41c0-dd60-40c1-967c-a43d6a700903'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:40.932296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17390a374ed84d319929f3e023d12401', 'request_id': 'req-806d41c0-dd60-40c1-967c-a43d6a700903'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:41.001863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17390a374ed84d319929f3e023d12401', 'request_id': 'req-806d41c0-dd60-40c1-967c-a43d6a700903'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:41.014025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] The token cache is being invalidate because project 17390a374ed84d319929f3e023d12401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:41.014311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:41.014947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-806d41c0-dd60-40c1-967c-a43d6a700903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:41.016736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1318/2620] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:40 2022] DELETE /identity/v3/projects/17390a374ed84d319929f3e023d12401 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:41.023149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.023631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.023758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.041002 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:41.046255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:41.099791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1303/2621] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:41.107663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.107958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.108267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.126981 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:41.128315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:41.137400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1319/2622] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:41.141604 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.151326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663fed7-69d2-4840-be88-0904be0bffcf None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.155858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.156500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.156779 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.157062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.157798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:41.158102 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.159690 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.170823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1304/2623] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:41.174942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.184766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d21c6-e22a-4820-8f8e-1b722e0d8e76 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.189415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.190065 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.190351 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.190631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.191321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.193843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.310524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1320/2624] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:41 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:41.314838 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.324924 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108a02b-34bc-42a8-9b9a-2bcccc06a8d4 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.383841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.384544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.384832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.385169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.385867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.387786 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.548555 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1305/2625] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:41 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:41.553852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.564380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71497-fceb-4d2f-95fc-b285057bd2f6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.569313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.572432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.572432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.572432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.572432 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.572985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.584359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1321/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:41.588374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.598919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfcb62-1fe8-4956-9fe1-fc85011bb2d7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.603522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.604209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.604493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.604766 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.605516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.607091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c508e1-6880-4386-ad85-9f3fdcc675c3 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.617656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1306/2627] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:41.621873 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.631916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3366f4-fbb8-4526-bfb1-bb33f5442063 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.636449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.637362 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.637650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.637927 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] PATH_INFO: `/v3/projects/38ecb9637e1249b99572e65cfc957ca4/users/dbec0dfbb00c4bccbcf27bff41cc678b/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.653122 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ecb9637e1249b99572e65cfc957ca4, user_id=dbec0dfbb00c4bccbcf27bff41cc678b, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.655777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.749046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1322/2628] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:41 2022] PUT /identity/v3/projects/38ecb9637e1249b99572e65cfc957ca4/users/dbec0dfbb00c4bccbcf27bff41cc678b/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:41.759927 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.760239 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.760518 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.787623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] MFA Rules not processed for user `dbec0dfbb00c4bccbcf27bff41cc678b`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:41.788818 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:41.865660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1307/2629] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:41.877705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:41.879971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:41.933692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bda7c-f33c-4811-b7a5-20ff278f0805 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:41.937357 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:41.938113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:41.938273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:41.938551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:41.947756 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:41.949221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:41.958825 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1323/2630] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:48.582793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:48.582793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:48.646136 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb1f7-f338-49a9-9bc5-bf13d1f94f8f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:48.650658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:48.651537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:48.651817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:48.652090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] PATH_INFO: `/v3/users/66b598ac97f547c1949986d6320a9c3c` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:48.653303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b598ac97f547c1949986d6320a9c3c)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:48.655225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:48.900735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b598ac97f547c1949986d6320a9c3c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:48.907363 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b598ac97f547c1949986d6320a9c3c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:48.908043 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b598ac97f547c1949986d6320a9c3c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:48.989573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b598ac97f547c1949986d6320a9c3c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:48.990198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b598ac97f547c1949986d6320a9c3c'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.011860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1308/2631] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:48 2022] DELETE /identity/v3/users/66b598ac97f547c1949986d6320a9c3c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:49.347926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:49.356754 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538eb33-48e2-4277-b9ad-87572bbcb31b service glance] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:49.430464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:49.431585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:49.432036 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:49.432481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] PATH_INFO: `/v3/projects/a7f6d9b7b15946b1ab2cb8912da86268` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:49.434066 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f6d9b7b15946b1ab2cb8912da86268)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:49.436062 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:49.569078 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f6d9b7b15946b1ab2cb8912da86268', 'request_id': 'req-f50a117b-a075-4e1e-b165-91dcc36da1da'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.574722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f6d9b7b15946b1ab2cb8912da86268', 'request_id': 'req-f50a117b-a075-4e1e-b165-91dcc36da1da'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.639995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f6d9b7b15946b1ab2cb8912da86268', 'request_id': 'req-f50a117b-a075-4e1e-b165-91dcc36da1da'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.652279 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] The token cache is being invalidate because project a7f6d9b7b15946b1ab2cb8912da86268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:49.652570 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.653252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.654788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1324/2632] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:49 2022] DELETE /identity/v3/projects/a7f6d9b7b15946b1ab2cb8912da86268 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:49.658833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:49.661024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:49.678252 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33878cc-dfd8-41e8-be33-b06598aeb7f6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:49.741505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:49.742381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:49.742661 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:49.742939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] PATH_INFO: `/v3/users/95a4a35856224edaa339da912153b0d5` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:49.744119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a4a35856224edaa339da912153b0d5)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:49.746075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:49.902817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a4a35856224edaa339da912153b0d5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.911468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a4a35856224edaa339da912153b0d5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.912188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a4a35856224edaa339da912153b0d5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.983026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a4a35856224edaa339da912153b0d5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:49.983650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d234969a-59d4-4f0a-a3c0-40971dcdd4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a4a35856224edaa339da912153b0d5'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.001287 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1309/2633] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:06:49 2022] DELETE /identity/v3/users/95a4a35856224edaa339da912153b0d5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:50.335603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:50.337127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:50.350539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a117b-a075-4e1e-b165-91dcc36da1da admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:50.411340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:50.412399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.412578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.412766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] PATH_INFO: `/v3/projects/349053d5688a44fcaff48d22f4f6f755` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.414365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=349053d5688a44fcaff48d22f4f6f755)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:50.416692 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:50.533390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349053d5688a44fcaff48d22f4f6f755', 'request_id': 'req-eea38241-35b4-4232-95c8-040e6117322e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.538893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349053d5688a44fcaff48d22f4f6f755', 'request_id': 'req-eea38241-35b4-4232-95c8-040e6117322e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.617589 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349053d5688a44fcaff48d22f4f6f755', 'request_id': 'req-eea38241-35b4-4232-95c8-040e6117322e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.630000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] The token cache is being invalidate because project 349053d5688a44fcaff48d22f4f6f755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:06:50.630301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.630972 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-eea38241-35b4-4232-95c8-040e6117322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:06:50.632776 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1325/2634] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:06:50 2022] DELETE /identity/v3/projects/349053d5688a44fcaff48d22f4f6f755 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:50.637860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.638237 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.638437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.657256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:50.658466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:50.721598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1310/2635] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:50.730698 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.731012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.731408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.751715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:50.752944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:50.762104 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1326/2636] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:50.766502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:50.776599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e1ea-76b4-44d6-bd33-671980942385 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:50.781373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:50.786687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:50.798305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1311/2637] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:06:50.803273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:50.812671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673618-5d0e-42f0-8f9f-aa7dd7d89f47 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:50.818454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:50.819121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.819408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.819684 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.820414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:50.822387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:50.915946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1327/2638] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:50.920167 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:50.934665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b40bab-24d5-4135-91c7-08d77c5eb505 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:50.995463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:50.996206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:50.996591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:50.996966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:50.997817 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:50.999875 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.098896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1312/2639] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:50 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:51.102653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.114917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a284e-8f7e-4945-b4ac-7e4ea23db248 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.121489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.122171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.122460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.122739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.123477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.125240 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.136946 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1328/2640] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:51.142932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.155179 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731de1e-1848-420b-80d2-237ead53f1c0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.159979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.161418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.161856 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.162134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.162929 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.164544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e1cb5-522b-47e3-8e09-f3f4920134dd admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.180134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1313/2641] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:06:51.181382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.191212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a787065-bf26-413a-b8b8-a97627c302ab admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.196264 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.197222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.197539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.197819 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] PATH_INFO: `/v3/projects/7b2cd3382123440ba390057397aaafd5/users/2999582dbce3478fbbfed7aec8628aeb/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.213000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2cd3382123440ba390057397aaafd5, user_id=2999582dbce3478fbbfed7aec8628aeb, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.215744 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.286955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1329/2642] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:51 2022] PUT /identity/v3/projects/7b2cd3382123440ba390057397aaafd5/users/2999582dbce3478fbbfed7aec8628aeb/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:51.297304 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fec49-2a70-4091-a942-1869107795af None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.297598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fec49-2a70-4091-a942-1869107795af None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.297879 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fec49-2a70-4091-a942-1869107795af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.326452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-5a1fec49-2a70-4091-a942-1869107795af None None] MFA Rules not processed for user `2999582dbce3478fbbfed7aec8628aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:51.327674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5a1fec49-2a70-4091-a942-1869107795af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:51.399507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1314/2643] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:06:51.401013 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.463228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78dfd2-54ef-479c-9f78-3a4cb7cdb7de admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.467909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.468563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.468849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.469154 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.469860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.471753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.578770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1330/2644] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:51 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:51.583522 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fec49-2a70-4091-a942-1869107795af None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.594759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fec49-2a70-4091-a942-1869107795af None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.651024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.651700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.651982 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.652257 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.652950 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.654906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.748798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1315/2645] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:51 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:51.753275 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.764626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c31e81-28eb-4887-bf87-7b10c5f32a47 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.769609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.771364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.771655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.771937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.772670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.774331 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.785831 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1331/2646] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:51.789850 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.799884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe494e-ce1d-454b-810c-d094328bdd84 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.804754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.805437 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.805725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.805979 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.806729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.808324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f7af89-959e-489e-9cf2-0a069b8b9c05 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.819396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1316/2647] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:51.823373 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:51.834352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91238d-650b-4104-84fe-999920369025 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:51.838803 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:51.839691 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.839976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.840254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] PATH_INFO: `/v3/projects/8ee7f47c9f8f457bb217174eced82f0f/users/314084c1c78842e985ee5f772f864302/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.855966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee7f47c9f8f457bb217174eced82f0f, user_id=314084c1c78842e985ee5f772f864302, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:51.858887 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:51.943397 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1332/2648] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:51 2022] PUT /identity/v3/projects/8ee7f47c9f8f457bb217174eced82f0f/users/314084c1c78842e985ee5f772f864302/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:51.953831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:51.954119 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:51.954392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:51.984796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] MFA Rules not processed for user `314084c1c78842e985ee5f772f864302`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:51.986034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:52.054443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1317/2649] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:52.059002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.120014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e82f62-2f91-4d74-98dd-77743b345013 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.124578 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.125263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.125556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.125838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.126532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.128442 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.242363 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1333/2650] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:06:52 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:06:52.246449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.258751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85714-2bda-4ffd-9319-99e7c3aff5ae None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.323925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.324622 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.324899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.325206 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.325909 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.327860 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.431553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1318/2651] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:06:52 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:06:52.435624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.446574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac507b41-6d6e-46e1-8e48-91199292509c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.451399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.452058 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.452344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.452614 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.453379 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.454984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.466074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1334/2652] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:52.470382 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.483591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631774da-c579-4dfd-9569-e191713d268f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.488259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.489823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.490268 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.490492 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] PATH_INFO: `/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e/users/eb85198275d9452aaf058d890ff5d1a6/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.505330 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9f1b6c7e0046aca703fb12f484e38e, user_id=eb85198275d9452aaf058d890ff5d1a6, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.508544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.612020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1319/2653] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:52 2022] PUT /identity/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e/users/eb85198275d9452aaf058d890ff5d1a6/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:52.616916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.627548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040b2f-d7cb-4682-a492-5b19eebf4db8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.684251 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.684861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.685178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.685455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.686178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.687769 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859571e-90e5-4fe2-81cd-b2efd667ddac admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.697997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1335/2654] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:06:52.702489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.713404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b741860-080c-438a-8cce-73a5ae0b9f87 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.718205 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.719095 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.719379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.719657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] PATH_INFO: `/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e/users/eb85198275d9452aaf058d890ff5d1a6/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.721751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9f1b6c7e0046aca703fb12f484e38e, user_id=eb85198275d9452aaf058d890ff5d1a6, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.725166 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.736513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1320/2655] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:06:52 2022] PUT /identity/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e/users/eb85198275d9452aaf058d890ff5d1a6/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:06:52.748319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.748616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.748903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.775616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] MFA Rules not processed for user `eb85198275d9452aaf058d890ff5d1a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:06:52.776834 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:52.844237 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1336/2656] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:06:52.862916 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:52.864852 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:52.926998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44f69c-1975-4ff1-bc40-b64e34c44ac9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:52.930781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:52.931428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:52.931714 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:52.931992 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:52.988353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:52.990452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:52.999783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1321/2657] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:55.014579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:55.024714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa7eb4-bdcf-4553-bab4-e6e965ecac5b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:55.028227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:55.028860 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:55.029171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:55.029447 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:55.084737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:55.086203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:55.094758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1337/2658] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:56.572004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:56.573541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:56.584894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3c234-c32a-45a4-bf8b-29839f0661bb service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:56.588484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:56.589159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:56.589446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:56.589725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:56.598355 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:56.600014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:56.609773 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1322/2659] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:06:58.259095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:06:58.267553 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5efe-a9de-47a6-8c33-edfc0fe2d1aa service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:06:58.272957 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:06:58.273806 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:06:58.274171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:06:58.274344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:06:58.276135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:06:58.333852 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:06:58.335315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30265859-fbb5-44a4-91a8-a5372d8c6a43 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:06:58.344338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1338/2660] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:06:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:04.748084 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:04.812967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189b7b9-95e2-4c34-a5ec-507b12963cf0 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:04.817603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:04.819091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:04.819377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:04.819656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] PATH_INFO: `/v3/users/2999582dbce3478fbbfed7aec8628aeb` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:04.820871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2999582dbce3478fbbfed7aec8628aeb)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:04.822816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:05.007625 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2999582dbce3478fbbfed7aec8628aeb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.014392 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2999582dbce3478fbbfed7aec8628aeb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.015055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2999582dbce3478fbbfed7aec8628aeb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.085381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2999582dbce3478fbbfed7aec8628aeb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.086004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2999582dbce3478fbbfed7aec8628aeb'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.102910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1323/2661] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:07:04 2022] DELETE /identity/v3/users/2999582dbce3478fbbfed7aec8628aeb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:05.107525 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:05.108265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:05.108265 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:05.125102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:05.126335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:05.184606 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1339/2662] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:07:05.194266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:05.195660 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:05.251460 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2537de2-51c5-4125-abc7-54eb25af5d5c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:05.255352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:05.256263 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:05.256378 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:05.256648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:05.265638 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:05.267126 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:05.276685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1324/2663] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:05.812738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:05.814287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:05.826932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b58bd8-d7c9-4fa9-bef6-17c26d1be339 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:05.831788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:05.832750 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:05.832967 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:05.833291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] PATH_INFO: `/v3/projects/7b2cd3382123440ba390057397aaafd5` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:05.834480 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2cd3382123440ba390057397aaafd5)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:05.837602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:05.955501 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2cd3382123440ba390057397aaafd5', 'request_id': 'req-2501a367-464b-4ce0-8727-75ca189f2906'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:05.962643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2cd3382123440ba390057397aaafd5', 'request_id': 'req-2501a367-464b-4ce0-8727-75ca189f2906'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.028319 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2cd3382123440ba390057397aaafd5', 'request_id': 'req-2501a367-464b-4ce0-8727-75ca189f2906'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.039768 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] The token cache is being invalidate because project 7b2cd3382123440ba390057397aaafd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:07:06.045005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.045005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.045005 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1340/2664] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:07:05 2022] DELETE /identity/v3/projects/7b2cd3382123440ba390057397aaafd5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:06.046207 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:06.055580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9c1c4-1b84-4e79-a3f8-98b0c60269ed service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:06.110608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:06.111468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:06.111745 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:06.112014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] PATH_INFO: `/v3/users/314084c1c78842e985ee5f772f864302` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:06.113210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314084c1c78842e985ee5f772f864302)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:06.115112 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:06.322044 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314084c1c78842e985ee5f772f864302'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.328895 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314084c1c78842e985ee5f772f864302'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.329609 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314084c1c78842e985ee5f772f864302'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.405457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314084c1c78842e985ee5f772f864302'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.406117 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314084c1c78842e985ee5f772f864302'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:06.424208 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1325/2665] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:07:06 2022] DELETE /identity/v3/users/314084c1c78842e985ee5f772f864302 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:06.847006 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:06.848499 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:06.863936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a367-464b-4ce0-8727-75ca189f2906 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:06.919333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:06.920186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:06.920463 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:06.920734 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] PATH_INFO: `/v3/projects/8ee7f47c9f8f457bb217174eced82f0f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:06.921939 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee7f47c9f8f457bb217174eced82f0f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:06.923821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:07.040215 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee7f47c9f8f457bb217174eced82f0f', 'request_id': 'req-94eef769-85ed-4b98-8ebe-9b24c73662e2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.045337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee7f47c9f8f457bb217174eced82f0f', 'request_id': 'req-94eef769-85ed-4b98-8ebe-9b24c73662e2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.131436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee7f47c9f8f457bb217174eced82f0f', 'request_id': 'req-94eef769-85ed-4b98-8ebe-9b24c73662e2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.143490 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] The token cache is being invalidate because project 8ee7f47c9f8f457bb217174eced82f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:07:07.143773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.144419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.146263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1341/2666] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:07:06 2022] DELETE /identity/v3/projects/8ee7f47c9f8f457bb217174eced82f0f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:07.151374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:07.152925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:07.166042 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c25ef-ffd2-4af6-aa6c-01f0cd34b618 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:07.220260 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:07.221281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:07.221568 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:07.221847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] PATH_INFO: `/v3/users/eb85198275d9452aaf058d890ff5d1a6` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:07.223026 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb85198275d9452aaf058d890ff5d1a6)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:07.225001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:07.425090 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb85198275d9452aaf058d890ff5d1a6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.432639 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb85198275d9452aaf058d890ff5d1a6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.433379 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb85198275d9452aaf058d890ff5d1a6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.525701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb85198275d9452aaf058d890ff5d1a6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.526314 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24c63617-1bc8-41df-9e83-e3f52f1c1488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb85198275d9452aaf058d890ff5d1a6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:07.543760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1326/2667] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:07:07 2022] DELETE /identity/v3/users/eb85198275d9452aaf058d890ff5d1a6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:08.007270 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.009450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:08.022387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eef769-85ed-4b98-8ebe-9b24c73662e2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.079307 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.080165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.080477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.080753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] PATH_INFO: `/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.081976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9f1b6c7e0046aca703fb12f484e38e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.083935 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.188598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9f1b6c7e0046aca703fb12f484e38e', 'request_id': 'req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:08.194080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9f1b6c7e0046aca703fb12f484e38e', 'request_id': 'req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:08.268321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9f1b6c7e0046aca703fb12f484e38e', 'request_id': 'req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:08.283042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] The token cache is being invalidate because project 2a9f1b6c7e0046aca703fb12f484e38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:07:08.283042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:08.283042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-ce5e3509-3a21-499b-b6d4-f52c811f4e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:08.283937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1342/2668] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:07:08 2022] DELETE /identity/v3/projects/2a9f1b6c7e0046aca703fb12f484e38e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:08.288845 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.290079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.290079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.308504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:08.309802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:08.368508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1327/2669] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:08.376106 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.376394 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.376671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.394611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:08.396077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:08.404070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1343/2670] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:08.408188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.418428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12435c-b08d-4402-b9ef-802662ba96e5 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.422921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.423563 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.423848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.424116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.424828 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:07:08.425174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.426787 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.438725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1328/2671] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:07:08.442740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.452378 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfc0b-9463-4eda-84d7-17c09a46fac2 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.457269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.457925 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.458207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.458492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.459176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.461705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.555863 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1344/2672] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:07:08 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:08.559970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.570128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26beec-a622-4a7f-aa79-ac991a87d696 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.626391 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.627062 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.627373 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.627650 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.628341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.630292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.737805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1329/2673] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:07:08 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:08.742050 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.753230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e8e-b05a-4b07-8151-c34fd9d2bc4c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.758488 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.759195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.759482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.760047 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.760783 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.762431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.774074 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1345/2674] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:08.778443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.788387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4c9e2-b500-49b8-bef3-fa2fa85eaf16 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.793833 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.794481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.794760 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.795032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.795747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.797362 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4481010-4b58-47cf-b5fa-4b15de3eebcd admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.807425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1330/2675] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:08.811402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:08.821245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e931f-8db3-4d7b-b6aa-9c8bb36f86c2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:08.825868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:08.826738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.827024 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.827301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] PATH_INFO: `/v3/projects/cd050e9e04f64b678b3dcc251e69eed3/users/0f8e05be61824d0598694520728bf80d/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:08.842242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd050e9e04f64b678b3dcc251e69eed3, user_id=0f8e05be61824d0598694520728bf80d, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:08.844916 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:08.908696 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1346/2676] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:07:08 2022] PUT /identity/v3/projects/cd050e9e04f64b678b3dcc251e69eed3/users/0f8e05be61824d0598694520728bf80d/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:08.975976 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52241a7-ed5a-4023-8a10-a56b53dccd0c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:08.976273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52241a7-ed5a-4023-8a10-a56b53dccd0c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:08.976581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52241a7-ed5a-4023-8a10-a56b53dccd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:09.009808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e52241a7-ed5a-4023-8a10-a56b53dccd0c None None] MFA Rules not processed for user `0f8e05be61824d0598694520728bf80d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:09.011124 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e52241a7-ed5a-4023-8a10-a56b53dccd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:09.083073 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1331/2677] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:09.096774 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:09.098536 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:09.164767 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5d981-e021-4064-9608-545b497fa6d7 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:09.170313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:09.170966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:09.171248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:09.171524 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:09.180910 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:09.182380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72981004-d57c-4040-95cb-0bee1aab60f4 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:09.194361 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1347/2678] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:11.056807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:11.057349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:11.057349 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:11.074858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] MFA Rules not processed for user `0f8e05be61824d0598694520728bf80d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:11.076046 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:11.082865 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1332/2679] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:11.339759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:11.342883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:11.342883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:11.357879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] MFA Rules not processed for user `e6a24932d7894c199f1374b9203c3873`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:11.359191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:11.415662 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1348/2680] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:13.578451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:13.579812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:13.650162 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1af68-7910-43b7-926d-d47e567c30b9 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:13.655324 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:13.656011 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:13.656296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:13.656574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:13.658381 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:13.670335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:13.671969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a274417-34d8-492a-a70c-e92a7fe1bcae service placement] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:13.682019 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1333/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:15.842546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:15.844436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:15.927718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57351e30-f127-4d80-8a14-4c849c236c01 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:15.932755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:15.934233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:15.934233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:15.934544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] PATH_INFO: `/v3/users/dbec0dfbb00c4bccbcf27bff41cc678b` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:15.935633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbec0dfbb00c4bccbcf27bff41cc678b)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:15.937685 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:16.215883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbec0dfbb00c4bccbcf27bff41cc678b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:16.216820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbec0dfbb00c4bccbcf27bff41cc678b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:16.225602 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbec0dfbb00c4bccbcf27bff41cc678b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:16.296733 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbec0dfbb00c4bccbcf27bff41cc678b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:16.297390 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbec0dfbb00c4bccbcf27bff41cc678b'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:16.315752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1349/2682] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:07:15 2022] DELETE /identity/v3/users/dbec0dfbb00c4bccbcf27bff41cc678b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:16.320515 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:16.321098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:16.321839 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:16.338765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:16.340072 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:16.399028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1334/2683] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:16.408649 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:16.410226 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:16.472847 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098be08-0aa8-44e0-8d2f-5c45ce43190e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:16.476718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:16.478205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:16.478467 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:16.478820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:16.488239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:16.489811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba664f3-8bf3-47e9-9c29-5e5c3f91ee33 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:16.500370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1350/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:17.194877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:17.197472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:17.218936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eacd3c-2014-42ac-881f-24cfd4df3c0b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:17.236572 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:17.238290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.247778 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.249296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] PATH_INFO: `/v3/projects/38ecb9637e1249b99572e65cfc957ca4` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.250877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ecb9637e1249b99572e65cfc957ca4)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:17.252877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:17.422932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ecb9637e1249b99572e65cfc957ca4', 'request_id': 'req-f6095263-a80c-40fe-9906-bed07ccd0d8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:17.432060 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ecb9637e1249b99572e65cfc957ca4', 'request_id': 'req-f6095263-a80c-40fe-9906-bed07ccd0d8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:17.559819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ecb9637e1249b99572e65cfc957ca4', 'request_id': 'req-f6095263-a80c-40fe-9906-bed07ccd0d8a'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:17.574540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] The token cache is being invalidate because project 38ecb9637e1249b99572e65cfc957ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:07:17.574830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:17.575664 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-f6095263-a80c-40fe-9906-bed07ccd0d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:17.578116 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1335/2685] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:07:17 2022] DELETE /identity/v3/projects/38ecb9637e1249b99572e65cfc957ca4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:17.583183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.587930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.587930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.604753 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:17.606085 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:17.677643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1351/2686] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:07:17.683041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.683339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.683623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.707614 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:17.708742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:17.716824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1336/2687] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:07:17.721251 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:17.731414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b2b2-f3d5-4265-a853-1b26ec3e4eb3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:17.736263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:17.737169 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.737457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.737736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.738498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:07:17.738804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:17.740403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:17.753958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1352/2688] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:07:17.758114 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:17.768471 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720f7f3-e126-401d-8e97-3987e93e1467 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:17.773744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:17.775549 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.775843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.776120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.776816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:17.778769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:17.890627 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1337/2689] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:07:17 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:17.891892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:17.903706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f0240-f9b8-4a9c-b745-6538df7c5020 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:17.968040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:17.968661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:17.968949 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:17.969272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:17.969973 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:17.971906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:18.048824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1353/2690] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:07:17 2022] POST /identity/v3/users => generated 281 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:18.050216 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:18.060831 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34543e-b56c-416a-babc-186aa97c5d60 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:18.066127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:18.066801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:18.067087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:18.067366 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:18.068093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:18.069749 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:18.081028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1338/2691] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:18.084960 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:18.095846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d631c-2bf5-471c-91a4-dc72e9c76966 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:18.105628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:18.105628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:18.105628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:18.105628 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:18.106004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:18.106004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957df0cd-6a3d-43f7-bae3-3530a88e5db0 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:18.115123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1354/2692] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:18.119407 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:18.129459 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f28eb-c2b4-417c-b2ce-04225c60478a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:18.134746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:18.145451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:18.145451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:18.145451 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] PATH_INFO: `/v3/projects/a68471c02c014a0b9c98a01a94ce3a0b/users/2464b96d85964b868da0b40bc0cbd696/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:18.151183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68471c02c014a0b9c98a01a94ce3a0b, user_id=2464b96d85964b868da0b40bc0cbd696, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:18.154049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:18.277493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1339/2693] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:07:18 2022] PUT /identity/v3/projects/a68471c02c014a0b9c98a01a94ce3a0b/users/2464b96d85964b868da0b40bc0cbd696/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:07:18.284288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:18.284902 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:18.285420 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:18.333643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] MFA Rules not processed for user `2464b96d85964b868da0b40bc0cbd696`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:18.335107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:18.450227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1355/2694] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:18.458584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:18.466032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:18.573706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae3ec7-d2d3-4024-a4e9-f81363a8a082 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:18.579100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:18.579100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:18.579100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:18.579506 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:18.593957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:18.595429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe3420-979b-41cb-a639-636e2ae4416c service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:18.606721 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1340/2695] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:37.739720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:37.741211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:37.806061 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af2b8-8c3d-4ea4-bb5d-90dbe0e4f683 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:37.808961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:37.809715 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:37.810071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:37.810461 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:37.812500 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:37.882671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:37.890365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:37.905322 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1356/2696] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:38.340351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323bb9-4999-4e8f-a8ce-29e00b724858 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:38.341342 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323bb9-4999-4e8f-a8ce-29e00b724858 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:38.341585 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323bb9-4999-4e8f-a8ce-29e00b724858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:38.364247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d9323bb9-4999-4e8f-a8ce-29e00b724858 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:38.365807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d9323bb9-4999-4e8f-a8ce-29e00b724858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:38.429420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1341/2697] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:38.599037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:38.600428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:38.683007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f488f-5fce-49c6-99c2-4bf7479a4537 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:38.695704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:38.696371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:38.696679 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:38.696959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:38.706541 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:38.708234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:38.725944 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1357/2698] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:07:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:07:39.695729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4fa7-dd1b-4235-94c6-b13f3f79cc71 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:39.696177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4fa7-dd1b-4235-94c6-b13f3f79cc71 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:39.696353 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb4fa7-dd1b-4235-94c6-b13f3f79cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:39.716280 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-3abb4fa7-dd1b-4235-94c6-b13f3f79cc71 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:39.717762 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-3abb4fa7-dd1b-4235-94c6-b13f3f79cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:39.726728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1342/2699] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:39.741514 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:39.753559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602bfa3-967d-4804-9380-47febe697d30 service swift] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:39.760405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:39.761243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:39.761796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:39.762400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:39.772272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:39.774196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:39.784139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1358/2700] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:07:40.489347 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e78b-fa34-4c08-ad51-77e68b6e7883 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:40.489981 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e78b-fa34-4c08-ad51-77e68b6e7883 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:40.490543 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3e78b-fa34-4c08-ad51-77e68b6e7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:40.523789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-63c3e78b-fa34-4c08-ad51-77e68b6e7883 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:40.525439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-63c3e78b-fa34-4c08-ad51-77e68b6e7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:40.534265 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1343/2701] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:40.549868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:40.560320 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f54b-9a2d-4094-8c0b-9a653f8e1738 service swift] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:40.567102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:40.568171 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:40.568704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:40.569183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:40.579111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:40.580787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:40.589612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1359/2702] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:07:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:07:41.275631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b5d9e-cabd-40dc-9199-404e68747ef6 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:41.276191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b5d9e-cabd-40dc-9199-404e68747ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:41.276191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b5d9e-cabd-40dc-9199-404e68747ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:41.295277 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-801b5d9e-cabd-40dc-9199-404e68747ef6 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:41.296570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-801b5d9e-cabd-40dc-9199-404e68747ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:41.304990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1344/2703] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:41.318458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:41.331216 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f34cee-e86a-40a4-bef7-c2efa866c3c5 service swift] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:41.336347 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:41.337274 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:41.337556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:41.337830 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:41.347942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:41.354882 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:41.359166 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1360/2704] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:07:43.048698 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba23e-4d78-46b8-9272-f3891d8a0da7 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:43.049224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba23e-4d78-46b8-9272-f3891d8a0da7 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:43.049445 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ba23e-4d78-46b8-9272-f3891d8a0da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:43.072670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-266ba23e-4d78-46b8-9272-f3891d8a0da7 None None] MFA Rules not processed for user `105bf4104bf949168bbe5c2c7eea0602`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:43.072670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-266ba23e-4d78-46b8-9272-f3891d8a0da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:43.123446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1345/2705] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:44.323893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:44.325365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:44.390712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bddf5-ff9d-4dd0-a77b-7654d012c556 service swift] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:44.400268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:44.401091 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:44.401380 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:44.401657 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] PATH_INFO: `/v3/users/0f8e05be61824d0598694520728bf80d` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:44.402864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8e05be61824d0598694520728bf80d)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:44.404885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:44.722212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8e05be61824d0598694520728bf80d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:44.722868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8e05be61824d0598694520728bf80d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:44.729584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8e05be61824d0598694520728bf80d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:44.809947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8e05be61824d0598694520728bf80d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:44.810593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8e05be61824d0598694520728bf80d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:44.827829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1361/2706] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:07:44 2022] DELETE /identity/v3/users/0f8e05be61824d0598694520728bf80d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:44.833161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:44.834049 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:44.834332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:44.852763 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:44.854009 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:44.912524 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1346/2707] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:07:44.922369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:44.923961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:44.985323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741b93-8ca2-4502-b5e2-476e69d59263 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:44.988755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:44.989452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:44.989738 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:44.990040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:44.999491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:45.001513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cecc5-fb84-41d0-888e-198fb7dd9585 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:45.011808 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1362/2708] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:45.299936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:45.301446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:45.317157 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5deda-1c0b-4736-a428-343b8cce7c1a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:45.323482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:45.324351 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:45.324631 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:45.324907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] PATH_INFO: `/v3/projects/cd050e9e04f64b678b3dcc251e69eed3` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:45.326193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd050e9e04f64b678b3dcc251e69eed3)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:45.328182 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:45.516024 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd050e9e04f64b678b3dcc251e69eed3', 'request_id': 'req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:45.522079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd050e9e04f64b678b3dcc251e69eed3', 'request_id': 'req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:45.674134 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd050e9e04f64b678b3dcc251e69eed3', 'request_id': 'req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:45.685672 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] The token cache is being invalidate because project cd050e9e04f64b678b3dcc251e69eed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:07:45.685959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:45.686584 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-e937bd6a-f057-4544-b8bc-55a9a4e2af3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:07:45.688128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1347/2709] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:07:45 2022] DELETE /identity/v3/projects/cd050e9e04f64b678b3dcc251e69eed3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:45.698844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:45.700247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:45.700247 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:45.717539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:45.718758 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:45.778538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1363/2710] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:45.787505 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:45.787901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:45.788194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:45.807177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:45.808374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:45.816485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1348/2711] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:45.820867 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:45.833607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554bc6-436d-4b24-8105-acfc13e1efd8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:45.838586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:45.839263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:45.839556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:45.839838 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:45.840565 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:07:45.840875 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:45.842567 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:45.854987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1364/2712] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:07:45.861637 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:45.870959 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8249150-c2bf-4a99-8561-5a778c08932b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:45.875597 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:45.876244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:45.876526 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:45.877123 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:45.877521 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:45.879415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:45.973129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1349/2713] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:07:45 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:07:45.981491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:45.992364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a689-415a-4cd3-b2af-3f67b48f5b42 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:46.046206 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:46.046870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.047173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.047433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.048125 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:46.050740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:46.211764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1365/2714] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:07:45 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:07:46.215934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:46.233606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daacc5-aa8f-4530-83d4-7214edf06f10 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:46.233606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:46.233606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.233606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.234081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.234081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:46.234910 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:46.245325 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1350/2715] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:07:46.249308 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:46.259597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6993c5-766a-4052-86db-51cff53cd7a1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:46.266143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:46.266899 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.267704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.267984 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.268730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:46.270413 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63c278-51eb-459f-84d5-3bd1e0abe04b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:46.281150 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1366/2716] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:46.286085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:46.295986 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcabb3-bf8c-44fb-9231-a9e8c7c39c10 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:46.301328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:46.302209 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.302489 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.302767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] PATH_INFO: `/v3/projects/b5a2dd2508944a3294061456a0a16b04/users/f9b818fa4ac442cc9b07b0e545560409/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.318168 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a2dd2508944a3294061456a0a16b04, user_id=f9b818fa4ac442cc9b07b0e545560409, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:46.320796 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:46.470282 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1351/2717] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:07:46 2022] PUT /identity/v3/projects/b5a2dd2508944a3294061456a0a16b04/users/f9b818fa4ac442cc9b07b0e545560409/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:46.476130 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ee8a-fc21-44e4-9dd3-3179e16ce230 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.476431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ee8a-fc21-44e4-9dd3-3179e16ce230 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.476728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89ee8a-fc21-44e4-9dd3-3179e16ce230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.498747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-db89ee8a-fc21-44e4-9dd3-3179e16ce230 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:46.498747 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-db89ee8a-fc21-44e4-9dd3-3179e16ce230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:46.560801 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1367/2718] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:46.572103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:46.575686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:46.637109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ec129-1752-4448-95e4-ef1aa29dc8d9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:46.640934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:46.641617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:46.641901 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:46.642176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:46.652387 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:46.653938 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:46.666083 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1352/2719] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:07:52.935872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:52.937437 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:52.937938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:52.970176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] MFA Rules not processed for user `f9b818fa4ac442cc9b07b0e545560409`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:07:52.972029 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:07:53.039673 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1368/2720] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:07:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:07:53.044225 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.054793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960830bc-dde6-45ec-95ad-d64f60c23c7e service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.059516 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.060248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.060599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.060936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.061722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.063848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.179045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1353/2721] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:07:53 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:53.183026 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.195388 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0a08-5a8d-4f88-916a-fab55afdc4a3 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.254256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.254968 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.255248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.255522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.256207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.258156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.336824 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1369/2722] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:07:53 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:07:53.340816 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.351648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c7cc8-77be-4dd6-bdc8-855ff9b4e262 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.356482 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.357326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.357606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.357877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.358602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.360222 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.371487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1354/2723] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:53.375786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.386189 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b601135-1db7-4213-a45d-4f1c72c89ada admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.390891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.391772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.392060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.392339 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] PATH_INFO: `/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3/users/717504ab1b824187a32ba621c4568f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.407995 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36ed3bea39f4ca1b01b18665ce66eb3, user_id=717504ab1b824187a32ba621c4568f45, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.411299 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.484707 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1370/2724] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:07:53 2022] PUT /identity/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3/users/717504ab1b824187a32ba621c4568f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:07:53.488808 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.498621 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f0c40-d57e-4b94-959b-3064f3ff58c0 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.554591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.555271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.555558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.555967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.556725 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.558457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36dd96-6d1a-45c3-8c43-2ace558a5971 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.568935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1355/2725] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:07:53.573081 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:07:53.583932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40ce98-b458-4a1a-b7b1-df374ca76057 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:07:53.588833 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:07:53.589849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:07:53.590198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:07:53.590585 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] PATH_INFO: `/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3/users/717504ab1b824187a32ba621c4568f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:07:53.597235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a36ed3bea39f4ca1b01b18665ce66eb3, user_id=717504ab1b824187a32ba621c4568f45, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:07:53.597235 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:07:53.607971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1371/2726] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:07:53 2022] PUT /identity/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3/users/717504ab1b824187a32ba621c4568f45/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:08:00.632536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:00.633177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:00.633300 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:00.664996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] MFA Rules not processed for user `717504ab1b824187a32ba621c4568f45`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:00.666629 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:00.767140 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1356/2727] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:00.778505 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:00.780334 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:00.842736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463892c1-3d1b-4a97-82d4-cb75ad95e162 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:00.850202 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '752019a13ba44236ba1c1e13aea6129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:00.850889 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:00.851172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:00.851599 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:00.916672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:00.918165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e8b8f-45dc-4b14-93b2-737887731569 service glance] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:00.929349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1372/2728] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:01.013736 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:01.015485 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:01.100289 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fc9d7-a4f9-456d-8b24-e745f2afb36b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:01.104906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:01.105827 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:01.106110 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:01.106388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] PATH_INFO: `/v3/users/2464b96d85964b868da0b40bc0cbd696` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:01.107599 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2464b96d85964b868da0b40bc0cbd696)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:01.109601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:01.193820 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:01.194183 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:01.194537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:01.213724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:01.215289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:01.270209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1373/2729] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:08:01.282643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:01.284134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:01.353989 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57887993-9639-4178-98dc-6a12c95cae0c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:01.355087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2464b96d85964b868da0b40bc0cbd696'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:01.359051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:01.359695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:01.360126 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:01.360402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:01.363397 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2464b96d85964b868da0b40bc0cbd696'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:01.364091 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2464b96d85964b868da0b40bc0cbd696'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:01.374718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:01.376406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd093977-fd32-4e28-9d7d-0172ce46b212 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:01.385661 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1374/2730] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:08:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 13:08:01.478798 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2464b96d85964b868da0b40bc0cbd696'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:01.479422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2464b96d85964b868da0b40bc0cbd696'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:01.496754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1357/2731] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:08:01 2022] DELETE /identity/v3/users/2464b96d85964b868da0b40bc0cbd696 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:08:01.501292 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:01.502214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:01.502546 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:01.520515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:01.522014 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:01.589732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1375/2732] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:01.599707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:01.601652 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:01.682747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d1181-dd29-484d-aa4c-ff9ca6ef3504 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:01.691465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:01.692255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:01.692643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:01.693012 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:01.712647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:01.714764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c110-aafa-4a3c-a614-8fa7a475d09f service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:01.727892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1358/2733] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:02.258714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:02.261985 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:02.317551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aa940-30c7-4ef3-9a35-f56925947970 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:02.345874 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:02.346997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:02.347472 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:02.348219 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] PATH_INFO: `/v3/projects/a68471c02c014a0b9c98a01a94ce3a0b` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:02.353723 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68471c02c014a0b9c98a01a94ce3a0b)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:02.362671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:02.561615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68471c02c014a0b9c98a01a94ce3a0b', 'request_id': 'req-b76af7b6-402d-4bdb-b927-a9f08cad5979'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:02.570869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68471c02c014a0b9c98a01a94ce3a0b', 'request_id': 'req-b76af7b6-402d-4bdb-b927-a9f08cad5979'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:02.650937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68471c02c014a0b9c98a01a94ce3a0b', 'request_id': 'req-b76af7b6-402d-4bdb-b927-a9f08cad5979'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:02.667710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] The token cache is being invalidate because project a68471c02c014a0b9c98a01a94ce3a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:08:02.668007 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:02.668725 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76af7b6-402d-4bdb-b927-a9f08cad5979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:02.670752 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1376/2734] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:08:02 2022] DELETE /identity/v3/projects/a68471c02c014a0b9c98a01a94ce3a0b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:08:02.676129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:02.676694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:02.677322 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:02.696486 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:02.699438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:02.782241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1359/2735] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:02.785129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:02.785755 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:02.786277 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:02.806318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:02.807917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:02.818042 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1377/2736] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:02.822008 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:02.844980 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880512b-0a82-4097-a6bb-7202c4719fed None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:02.855335 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:02.856017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:02.856303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:02.857278 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:02.858240 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:08:02.858388 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:02.859990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:02.879832 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1360/2737] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:08:02.881728 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:02.899401 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490c093-e0c6-4822-a8a6-a11d522327d8 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:02.904511 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:02.905282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:02.905646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:02.905991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:02.907094 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:02.909370 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.046976 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1378/2738] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:08:02 2022] POST /identity/v3/projects => generated 399 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:08:03.048213 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:03.063632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e631ab-7687-4735-825d-6473cf4cdc02 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:03.155331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:03.155579 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.155902 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.156103 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.156805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:03.160247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.255889 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1361/2739] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:08:03 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:08:03.259689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:03.271558 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77fe45-e283-4b88-9276-70bac405b631 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:03.276666 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:03.277381 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.277789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.278172 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.279025 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:03.280764 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.292290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1379/2740] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:08:03.297170 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:03.308340 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475352-244e-4c5b-adde-c2ff0bc5ee70 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:03.314671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:03.315733 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.316214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.316567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.317900 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:03.319318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643cbd6-46e3-47cd-9fb2-5ef9ed20d787 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.334501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1362/2741] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:08:03.337149 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:03.347779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d7d5-3e36-49bc-abcc-2314d2c7ba0d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:03.352544 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:03.357612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.357612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.357612 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] PATH_INFO: `/v3/projects/1fc46906d3664a0b9758e06204762ba5/users/97d167bbe3d6480b99baa6a91d286c86/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.371971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc46906d3664a0b9758e06204762ba5, user_id=97d167bbe3d6480b99baa6a91d286c86, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:03.374842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.464518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1380/2742] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:08:03 2022] PUT /identity/v3/projects/1fc46906d3664a0b9758e06204762ba5/users/97d167bbe3d6480b99baa6a91d286c86/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:08:03.478155 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616708-d9f5-47ca-ab3b-4ccc94fa210e None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.478679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616708-d9f5-47ca-ab3b-4ccc94fa210e None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.479159 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b616708-d9f5-47ca-ab3b-4ccc94fa210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.542032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2b616708-d9f5-47ca-ab3b-4ccc94fa210e None None] MFA Rules not processed for user `97d167bbe3d6480b99baa6a91d286c86`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:03.544147 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2b616708-d9f5-47ca-ab3b-4ccc94fa210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:03.652108 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1363/2743] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:03.662203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:03.664239 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:03.781605 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81403f-b092-4152-a7bc-ae0aedfad984 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:03.792671 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:03.793481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:03.793829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:03.794179 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:03.809883 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:03.811464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:03.824046 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1381/2744] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:12.094536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b141-d207-4616-a66c-4b486e86a2a8 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:12.095056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b141-d207-4616-a66c-4b486e86a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:12.095227 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3b141-d207-4616-a66c-4b486e86a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:12.112217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-7fe3b141-d207-4616-a66c-4b486e86a2a8 None None] MFA Rules not processed for user `f9b818fa4ac442cc9b07b0e545560409`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:12.113470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7fe3b141-d207-4616-a66c-4b486e86a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:12.166175 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1364/2745] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:13.397258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:13.457637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397edf93-615f-4199-8b9a-295623bbf652 service cinder] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:13.462353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:13.463214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:13.466102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:13.466102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] PATH_INFO: `/v3/users/97d167bbe3d6480b99baa6a91d286c86` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:13.466102 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d167bbe3d6480b99baa6a91d286c86)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:13.466932 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:13.670675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d167bbe3d6480b99baa6a91d286c86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:13.670675 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d167bbe3d6480b99baa6a91d286c86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:13.677594 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d167bbe3d6480b99baa6a91d286c86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:13.782048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d167bbe3d6480b99baa6a91d286c86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:13.782624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d167bbe3d6480b99baa6a91d286c86'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:13.799827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1382/2746] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:08:13 2022] DELETE /identity/v3/users/97d167bbe3d6480b99baa6a91d286c86 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:08:13.804428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:13.804928 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:13.805028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:13.822829 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:13.824023 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:13.882811 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1365/2747] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:13.893492 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:13.894990 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:13.953712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94094a96-64a7-4506-9715-b6a3d543d51b admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:13.957533 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:13.958222 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:13.958504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:13.958779 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:13.967538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:13.968955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0210f-d44d-45ca-8342-9be9910da3c1 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:13.978145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1383/2748] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:08:14.441061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:14.442761 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:14.456435 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f27c3-2c5a-4384-b567-a82ea2c42e9a None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:14.462228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:14.463337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:14.463820 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:14.464259 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] PATH_INFO: `/v3/projects/1fc46906d3664a0b9758e06204762ba5` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:14.465679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc46906d3664a0b9758e06204762ba5)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:14.467970 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:14.593508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc46906d3664a0b9758e06204762ba5', 'request_id': 'req-9d591835-31c0-4e5b-bc32-4a4b05296c00'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:14.599393 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc46906d3664a0b9758e06204762ba5', 'request_id': 'req-9d591835-31c0-4e5b-bc32-4a4b05296c00'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:14.673127 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc46906d3664a0b9758e06204762ba5', 'request_id': 'req-9d591835-31c0-4e5b-bc32-4a4b05296c00'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:14.684658 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] The token cache is being invalidate because project 1fc46906d3664a0b9758e06204762ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:08:14.684967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:14.685644 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:08:14.688530 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1366/2749] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:08:14 2022] DELETE /identity/v3/projects/1fc46906d3664a0b9758e06204762ba5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:08:16.015261 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:16.015737 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:16.015836 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:16.033740 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:08:16.034945 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:16.100717 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1384/2750] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 11 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:08:16.129447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:16.129447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:16.228269 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591835-31c0-4e5b-bc32-4a4b05296c00 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:16.233801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:16.234350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:16.234632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:16.234907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:16.244758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:16.246805 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:16.256336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1367/2751] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:08:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:08:18.527389 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:18.528842 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:18.587556 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269c04b-ccb1-4b05-a82f-6cc913a3e392 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:18.591198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:18.591853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:18.592139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:18.592414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:18.594306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:18.670851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:18.672340 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:18.684573 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1385/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:19.870457 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:19.871882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:19.883822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f23c6-2d23-4dd9-8336-cb736845a619 service swift] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:19.887493 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:19.888137 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:19.888423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:19.888700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:19.890503 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:19.906214 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:19.907685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:19.919556 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1368/2753] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:45.060142 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:45.068789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425108a-7b48-41a2-af1c-3fabd609b7b1 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:45.072659 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:45.073335 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:45.073619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:45.073893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:45.075742 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:45.150885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:45.152312 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:45.162318 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1386/2754] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:08:47.486276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:08:47.497396 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec58a1-1bec-4baf-be43-94562c57bd30 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:08:47.501430 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:08:47.504454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:08:47.504454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:08:47.504454 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:08:47.504967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:08:47.515188 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:08:47.516632 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:08:47.526767 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1369/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:08:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 13:09:14.719901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:14.721445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:14.737697 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f20884-1b2e-4386-9eb0-0a25ac7bf0b1 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:14.743427 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:14.744336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:14.744790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:14.745387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:14.748153 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:14.817572 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:14.819090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:14.832710 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1387/2756] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:20.564740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:20.578491 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5610d0d-808a-4e6f-b46b-5ee447944a5a service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:20.583988 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:20.584668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:20.584953 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:20.585276 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:20.587041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:20.599181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:20.600759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:20.616021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1370/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:20.924037 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:20.934736 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562c656-4b44-480a-9a6b-f65aee843087 service nova] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:20.938837 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:20.939507 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:20.939794 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:20.940071 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:20.942178 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:21.012207 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:21.013955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:21.024201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1388/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:25.141601 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:25.143305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:25.158096 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7deae-bcab-41a7-ac77-ca73ba92c7aa service nova] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:25.162673 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:25.163569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:25.163846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:25.164118 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] PATH_INFO: `/v3/users/105bf4104bf949168bbe5c2c7eea0602` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:25.165473 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105bf4104bf949168bbe5c2c7eea0602)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:25.167425 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:25.412138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105bf4104bf949168bbe5c2c7eea0602'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:25.419885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105bf4104bf949168bbe5c2c7eea0602'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:25.420590 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105bf4104bf949168bbe5c2c7eea0602'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:25.494439 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105bf4104bf949168bbe5c2c7eea0602'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:25.495199 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8bc19379-492b-4fa5-a35e-3c3b06536762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105bf4104bf949168bbe5c2c7eea0602'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:25.513956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1371/2759] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:25 2022] DELETE /identity/v3/users/105bf4104bf949168bbe5c2c7eea0602 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:25.802084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:25.808212 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cafea-55b5-49a2-b2cf-dd6eb92555b8 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:25.875344 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:25.876213 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:25.876496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:25.876888 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] PATH_INFO: `/v3/projects/2c353aef3e574c449532b2c4a2bb08b1` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:25.877997 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c353aef3e574c449532b2c4a2bb08b1)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:25.879898 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.015296 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c353aef3e574c449532b2c4a2bb08b1', 'request_id': 'req-70462cdf-d683-40fa-83b4-61faf271e4f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:26.020735 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c353aef3e574c449532b2c4a2bb08b1', 'request_id': 'req-70462cdf-d683-40fa-83b4-61faf271e4f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:26.111839 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c353aef3e574c449532b2c4a2bb08b1', 'request_id': 'req-70462cdf-d683-40fa-83b4-61faf271e4f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:26.123784 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] The token cache is being invalidate because project 2c353aef3e574c449532b2c4a2bb08b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:26.128623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:26.128623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-70462cdf-d683-40fa-83b4-61faf271e4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:26.128623 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1389/2760] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:25 2022] DELETE /identity/v3/projects/2c353aef3e574c449532b2c4a2bb08b1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:26.131223 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.131514 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.131793 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.150423 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:26.151681 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:26.227429 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1372/2761] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:26.234987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.235485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.235763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.254854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:26.256332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:26.269551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1390/2762] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:26.273742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.283633 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65411bc7-140c-4ebf-9d16-92a0cb5f9931 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.288296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.294598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.306654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1373/2763] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:09:26.311040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.321586 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b069f-d05d-4a42-82f6-4e7640ec7015 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.326522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.327259 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.327596 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.328055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.328759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.330706 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.471290 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1391/2764] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:26.472896 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.483606 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7845e73-f25c-44be-a613-119ab54622d6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.549156 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.550255 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.550707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.551173 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.552219 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.554998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.662273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1374/2765] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:26.668872 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.682176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609aeb8-75e0-4e6b-abdf-b02db37f41d6 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.688282 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.689435 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.689974 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.690595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.692123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.695305 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.709258 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1392/2766] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:26.713233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.724420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47569a75-fba5-4e11-b3fc-a7337f718776 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.729338 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.730014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.730934 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.731354 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.732089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.733737 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7151-d64f-4030-8235-f1d5b709a30a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.744647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1375/2767] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:09:26.749453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:26.759821 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30bc87-4d41-472c-82e3-4abf1d4515cb admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:26.765250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:26.766220 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.766579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.766921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] PATH_INFO: `/v3/projects/0b3a198129df4965835c8c614b36e266/users/15c088be3e364d3a9bf574713c2760f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.782622 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3a198129df4965835c8c614b36e266, user_id=15c088be3e364d3a9bf574713c2760f5, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:26.785445 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:26.866611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1393/2768] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:26 2022] PUT /identity/v3/projects/0b3a198129df4965835c8c614b36e266/users/15c088be3e364d3a9bf574713c2760f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:26.877409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:26.877743 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:26.878025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:26.908309 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] MFA Rules not processed for user `15c088be3e364d3a9bf574713c2760f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:26.909570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:26.975380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1376/2769] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:26.979663 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.042624 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87e38-fcae-4b34-84a5-f15c33e8eb48 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.047345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.048002 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.048287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.048563 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.049302 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.051204 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.136332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1394/2770] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:26 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:27.141475 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.153133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10081-c38f-47a2-902b-388cb2cd6111 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.209830 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.210504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.210789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.211064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.211750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.213706 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.300746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1377/2771] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:27 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:27.304777 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.316051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea22d-ad08-433c-85b4-f21a8b953796 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.321004 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.321791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.322012 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.322689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.322999 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.325458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.336502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1395/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:09:27.340871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.350836 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2fea-2dd5-41d1-bf97-9d273b653a05 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.355529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.356504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.356759 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.357030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] PATH_INFO: `/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e/users/c067c755d1e2408b9d67d3eba4326bb2/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.372624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c906537e2f2b4b06b49ef05ae00fa74e, user_id=c067c755d1e2408b9d67d3eba4326bb2, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.375337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.472727 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1378/2773] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:27 2022] PUT /identity/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e/users/c067c755d1e2408b9d67d3eba4326bb2/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:27.476598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.486595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e122-1e96-4916-9592-5cc1415995c9 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.541243 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.541911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.542198 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.542481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.543256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.544854 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415109e7-605b-4c03-82d2-d3017b8a6384 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.554539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1396/2774] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:27.558952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.569247 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522eb68-edb3-4d5a-96aa-55fc4f6cda77 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.574419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.575326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.575612 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.582466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] PATH_INFO: `/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e/users/c067c755d1e2408b9d67d3eba4326bb2/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.582466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c906537e2f2b4b06b49ef05ae00fa74e, user_id=c067c755d1e2408b9d67d3eba4326bb2, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.582466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.591286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1379/2775] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:27 2022] PUT /identity/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e/users/c067c755d1e2408b9d67d3eba4326bb2/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:27.601252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.601521 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.601804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.628695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] MFA Rules not processed for user `c067c755d1e2408b9d67d3eba4326bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:27.630121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:27.696164 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1397/2776] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:27.707418 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:27.709111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:27.768702 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935d967-a911-4169-9a9d-a6070c347407 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:27.772541 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:27.773211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:27.773500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:27.773775 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:27.782647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:27.784077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916770a-7a72-47f2-967e-169e66d7c801 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:27.793726 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1380/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:27.941781 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:28.002626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88596a0-72b0-4c33-a7c6-85e255bdd87b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:28.023087 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:28.024080 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:28.024436 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:28.024787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] PATH_INFO: `/v3/users/15c088be3e364d3a9bf574713c2760f5` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:28.026704 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c088be3e364d3a9bf574713c2760f5)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:28.029249 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:28.250387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c088be3e364d3a9bf574713c2760f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:28.251038 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c088be3e364d3a9bf574713c2760f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:28.257732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c088be3e364d3a9bf574713c2760f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:28.323000 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c088be3e364d3a9bf574713c2760f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:28.323588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c088be3e364d3a9bf574713c2760f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:28.342131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1398/2778] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:27 2022] DELETE /identity/v3/users/15c088be3e364d3a9bf574713c2760f5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:28.346624 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:28.347085 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:28.347197 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:28.364918 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:28.366149 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:28.427101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1381/2779] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:28.435040 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:28.436438 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:28.494975 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a78ad1-4c41-4128-83da-d764ac29715e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:28.498869 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:28.499516 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:28.499798 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:28.500075 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:28.509538 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:28.511196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:28.522406 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1399/2780] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:29.034125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:29.035906 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:29.050897 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03129f-7487-476f-985f-aedf7f8e5d7f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:29.056776 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:29.058059 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:29.058802 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:29.059087 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] PATH_INFO: `/v3/projects/0b3a198129df4965835c8c614b36e266` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:29.060529 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3a198129df4965835c8c614b36e266)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:29.063951 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:29.191789 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3a198129df4965835c8c614b36e266', 'request_id': 'req-34ab1104-9eaf-4605-a627-5c2f8560c5c6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.197512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3a198129df4965835c8c614b36e266', 'request_id': 'req-34ab1104-9eaf-4605-a627-5c2f8560c5c6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.288575 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3a198129df4965835c8c614b36e266', 'request_id': 'req-34ab1104-9eaf-4605-a627-5c2f8560c5c6'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.300949 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] The token cache is being invalidate because project 0b3a198129df4965835c8c614b36e266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:29.301270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.301892 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.303426 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1382/2781] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:29 2022] DELETE /identity/v3/projects/0b3a198129df4965835c8c614b36e266 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:29.307450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:29.317979 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57d79-7697-4841-aeba-510a82f23732 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:29.379699 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:29.380583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:29.380880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:29.381176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] PATH_INFO: `/v3/users/c067c755d1e2408b9d67d3eba4326bb2` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:29.382387 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c067c755d1e2408b9d67d3eba4326bb2)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:29.384336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:29.617113 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c067c755d1e2408b9d67d3eba4326bb2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.617901 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c067c755d1e2408b9d67d3eba4326bb2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.626419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c067c755d1e2408b9d67d3eba4326bb2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.706245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c067c755d1e2408b9d67d3eba4326bb2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.709174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-aa25412c-5dca-4bba-b89f-a31cf887ae54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c067c755d1e2408b9d67d3eba4326bb2'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:29.733079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1400/2782] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:29 2022] DELETE /identity/v3/users/c067c755d1e2408b9d67d3eba4326bb2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:30.186990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:30.188483 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:30.202674 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab1104-9eaf-4605-a627-5c2f8560c5c6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:30.258434 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:30.259296 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.259608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.259882 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] PATH_INFO: `/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.261065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c906537e2f2b4b06b49ef05ae00fa74e)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:30.263835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:30.377758 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c906537e2f2b4b06b49ef05ae00fa74e', 'request_id': 'req-9eafb535-659f-40d3-a3ca-e78be8b47f21'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:30.384538 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c906537e2f2b4b06b49ef05ae00fa74e', 'request_id': 'req-9eafb535-659f-40d3-a3ca-e78be8b47f21'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:30.483045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c906537e2f2b4b06b49ef05ae00fa74e', 'request_id': 'req-9eafb535-659f-40d3-a3ca-e78be8b47f21'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:30.494390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] The token cache is being invalidate because project c906537e2f2b4b06b49ef05ae00fa74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:30.494680 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:30.495305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-9eafb535-659f-40d3-a3ca-e78be8b47f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:30.497724 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1383/2783] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:30 2022] DELETE /identity/v3/projects/c906537e2f2b4b06b49ef05ae00fa74e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:30.517743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.518230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.518333 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.535892 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:30.537110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:30.594917 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1401/2784] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:30.602588 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.602919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.603233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.622332 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:30.623544 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:30.631566 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1384/2785] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:30.635683 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:30.645325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c40cf0-bd26-4d5a-94d6-e23a269575f4 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:30.650138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:30.650785 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.651069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.651345 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.652146 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:30.652504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:30.654137 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:30.665233 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1402/2786] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 13:09:30.669969 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:30.679016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1d458-2119-427a-8bc2-40d34c78681f None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:30.684228 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:30.684868 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.685193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.685466 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.686183 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:30.688075 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:30.822756 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1385/2787] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:30 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:30.829254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:30.840966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446e31f-3f24-4bed-a70a-2cd59b021caa admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:30.902405 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:30.903185 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:30.903471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:30.903751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:30.904465 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:30.906496 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:31.026588 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1403/2788] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:30 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:31.031006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:31.041507 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b8a87-76ac-4d53-8da7-f7b6976307ac admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:31.046343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:31.047004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:31.047292 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:31.047564 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:31.048293 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:31.049932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:31.061241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1386/2789] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:31.065244 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:31.076197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edc75b-2d48-469f-90a3-da603d067264 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:31.080773 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:31.081457 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:31.081743 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:31.082022 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:31.082751 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:31.084338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b88fcd-369f-48f5-9383-2cb521b5a338 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:31.095458 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1404/2790] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:31.099746 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:31.110176 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197079e4-0840-43af-a6f0-466800468118 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:31.114854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:31.115920 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:31.116224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:31.116501 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] PATH_INFO: `/v3/projects/212fbdc84420419990eb742a1bbd7dd8/users/4bb2d8072a044cf9833a15501288f1a2/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:31.131562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=212fbdc84420419990eb742a1bbd7dd8, user_id=4bb2d8072a044cf9833a15501288f1a2, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:31.134374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:31.219678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1387/2791] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:31 2022] PUT /identity/v3/projects/212fbdc84420419990eb742a1bbd7dd8/users/4bb2d8072a044cf9833a15501288f1a2/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:31.224909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7413f-98a1-46b4-90e0-8a9248511373 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:31.230757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7413f-98a1-46b4-90e0-8a9248511373 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:31.230757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7413f-98a1-46b4-90e0-8a9248511373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:31.244133 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-93e7413f-98a1-46b4-90e0-8a9248511373 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:31.245430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-93e7413f-98a1-46b4-90e0-8a9248511373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:31.303937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1405/2792] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:31.314965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:31.318050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:31.380069 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d372f9-0b2c-4e49-bce2-246160ff4ef6 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:31.384003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:31.384823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:31.385253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:31.385636 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:31.397634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:31.399212 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:31.410872 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1388/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:32.817900 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:32.819365 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:32.819804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:32.858994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] MFA Rules not processed for user `4bb2d8072a044cf9833a15501288f1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:32.860792 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:32.931947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1406/2794] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:09:32.936685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:32.949569 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422520-37d4-46ab-af0a-93713bfe25d6 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:32.954548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:32.955193 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:32.955477 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:32.955751 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:32.956448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:32.958394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.047819 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1389/2795] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:32 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:33.048996 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:33.060371 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6a22-f1c7-4ea6-a27b-9e90d086c084 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:33.119864 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:33.120531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:33.121506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:33.121796 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:33.122515 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:33.124474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.214896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1407/2796] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:33 2022] POST /identity/v3/users => generated 308 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:33.218716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:33.228841 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13752e60-3eb6-463b-a2c2-69526d1c7132 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:33.233657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:33.234313 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:33.234602 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:33.234883 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:33.235705 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:33.237271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.248678 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1390/2797] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:33.253392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:33.266459 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11faa2-4d8b-4b32-a695-8d1f46187232 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:33.273383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:33.273383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:33.273383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:33.273383 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] PATH_INFO: `/v3/projects/81daf0cf34d54d0da7955b87950d6c89/users/7073b1530cec40d28e8df12a59db4b36/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:33.288695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81daf0cf34d54d0da7955b87950d6c89, user_id=7073b1530cec40d28e8df12a59db4b36, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:33.293330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.381262 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1408/2798] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:33 2022] PUT /identity/v3/projects/81daf0cf34d54d0da7955b87950d6c89/users/7073b1530cec40d28e8df12a59db4b36/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:33.382344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:33.393067 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd370-2732-4af9-913d-f21e6bc385d9 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:33.451562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:33.452232 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:33.452520 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:33.452956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:33.453635 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:33.455251 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.465573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1391/2799] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:09:33.470123 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:33.483636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442861e-fa62-460f-ad0e-c18805b55056 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:33.489689 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:33.490879 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:33.491338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:33.491787 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] PATH_INFO: `/v3/projects/81daf0cf34d54d0da7955b87950d6c89/users/7073b1530cec40d28e8df12a59db4b36/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:33.494829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81daf0cf34d54d0da7955b87950d6c89, user_id=7073b1530cec40d28e8df12a59db4b36, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:33.499584 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010bf3-ba8f-4d82-bcc7-14bfd1a0704f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:33.510287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1409/2800] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:33 2022] PUT /identity/v3/projects/81daf0cf34d54d0da7955b87950d6c89/users/7073b1530cec40d28e8df12a59db4b36/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:34.837061 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:34.838876 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:34.899753 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8f1b4-9788-4841-98b0-7f5651b55adf admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:34.940705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:34.941288 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:34.941425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:34.954484 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:34.955281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:34.955623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:34.955905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:34.958099 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:34.974554 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] MFA Rules not processed for user `7073b1530cec40d28e8df12a59db4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:34.975807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:35.029249 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:35.030695 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:35.041794 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1392/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:35.051535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1410/2802] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:09:36.614574 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:36.631194 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66417a55-2aea-4593-8440-9d2b8aa038a8 service neutron] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:36.633716 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:36.634768 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:36.635052 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:36.635326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] PATH_INFO: `/v3/users/4bb2d8072a044cf9833a15501288f1a2` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:36.636843 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb2d8072a044cf9833a15501288f1a2)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:36.638899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:36.825613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb2d8072a044cf9833a15501288f1a2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:36.833995 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb2d8072a044cf9833a15501288f1a2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:36.834741 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb2d8072a044cf9833a15501288f1a2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:36.911306 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb2d8072a044cf9833a15501288f1a2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:36.911930 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb2d8072a044cf9833a15501288f1a2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:36.933327 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1393/2803] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:36 2022] DELETE /identity/v3/users/4bb2d8072a044cf9833a15501288f1a2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:37.223609 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:37.235611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e00c-5bcf-4724-8e22-4a756524345e None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:37.297477 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:37.298352 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:37.298632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:37.298908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] PATH_INFO: `/v3/projects/212fbdc84420419990eb742a1bbd7dd8` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:37.300116 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212fbdc84420419990eb742a1bbd7dd8)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:37.302045 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:37.449278 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212fbdc84420419990eb742a1bbd7dd8', 'request_id': 'req-69a03341-f702-4435-abc8-7b0da08faed5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.454537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212fbdc84420419990eb742a1bbd7dd8', 'request_id': 'req-69a03341-f702-4435-abc8-7b0da08faed5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.545575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212fbdc84420419990eb742a1bbd7dd8', 'request_id': 'req-69a03341-f702-4435-abc8-7b0da08faed5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.556988 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] The token cache is being invalidate because project 212fbdc84420419990eb742a1bbd7dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:37.557311 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.559070 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.561205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1411/2804] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:37 2022] DELETE /identity/v3/projects/212fbdc84420419990eb742a1bbd7dd8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:37.565013 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:37.566551 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:37.580138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf19a0-691a-4fff-9b39-ee7796c823d3 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:37.635848 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:37.637558 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:37.637851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:37.638129 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] PATH_INFO: `/v3/users/7073b1530cec40d28e8df12a59db4b36` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:37.639331 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7073b1530cec40d28e8df12a59db4b36)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:37.641408 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:37.873926 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7073b1530cec40d28e8df12a59db4b36'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.880671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7073b1530cec40d28e8df12a59db4b36'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.881415 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7073b1530cec40d28e8df12a59db4b36'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.963244 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7073b1530cec40d28e8df12a59db4b36'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.963801 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-30abde52-6fcd-4a84-9e50-122d82a12c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7073b1530cec40d28e8df12a59db4b36'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:37.981962 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1394/2805] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:37 2022] DELETE /identity/v3/users/7073b1530cec40d28e8df12a59db4b36 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:38.275090 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:38.277681 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:38.312790 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a03341-f702-4435-abc8-7b0da08faed5 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:38.385770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:38.386966 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:38.387430 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:38.387868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] PATH_INFO: `/v3/projects/81daf0cf34d54d0da7955b87950d6c89` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:38.389909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=81daf0cf34d54d0da7955b87950d6c89)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:38.392251 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:38.537908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81daf0cf34d54d0da7955b87950d6c89', 'request_id': 'req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:38.545008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81daf0cf34d54d0da7955b87950d6c89', 'request_id': 'req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:38.655077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81daf0cf34d54d0da7955b87950d6c89', 'request_id': 'req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:38.670579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] The token cache is being invalidate because project 81daf0cf34d54d0da7955b87950d6c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:38.671321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:38.672639 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-131ad019-31e0-4a6b-a6ab-de1bf76ffd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:38.678315 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1412/2806] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:38 2022] DELETE /identity/v3/projects/81daf0cf34d54d0da7955b87950d6c89 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:38.679509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:38.679975 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:38.680080 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:38.705791 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:38.707010 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:38.788161 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1395/2807] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:09:38.796232 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:38.796645 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:38.797188 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:38.818971 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:38.822414 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:38.833650 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1413/2808] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:38.842971 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:38.853310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a6d6-40f3-40a0-b59a-b2ae49ac5db2 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:38.858560 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:38.859220 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:38.859504 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:38.863608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:38.863608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:38.863608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:38.863608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:38.874734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1396/2809] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:09:38.879109 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:38.889429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a53dfc-c31e-42bf-b3ae-5bab0014b60c None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:38.894473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:38.895129 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:38.895419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:38.895705 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:38.896408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:38.898937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.044209 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1414/2810] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:38 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:39.045562 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.055509 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d779-98fa-431a-8680-be9a835ad8b7 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.110531 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.111204 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.111488 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.111764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.112453 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.114400 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.220464 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1397/2811] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:39 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:39.225097 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.238431 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6072b-955d-494b-aef5-caf3a8436d83 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.243732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.244506 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.244817 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.245121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.246566 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.248269 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.259073 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1415/2812] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:39.263936 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.274109 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919754dd-d282-40f6-9a6d-bc5afb54555f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.279416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.280089 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.280377 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.280685 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.281448 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.283055 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f0f41-dc57-46cf-8450-40937c7b6187 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.293952 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1398/2813] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:39.301161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.315766 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523e4d-2e54-4d9c-b391-ed192c985a14 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.321964 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.323156 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.324330 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.324745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] PATH_INFO: `/v3/projects/5933e0d5e7224a3788b15b71327d7b42/users/ea69e40ad5324b309eadc3580136cc0f/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.343695 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5933e0d5e7224a3788b15b71327d7b42, user_id=ea69e40ad5324b309eadc3580136cc0f, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.347918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.452310 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1416/2814] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:39 2022] PUT /identity/v3/projects/5933e0d5e7224a3788b15b71327d7b42/users/ea69e40ad5324b309eadc3580136cc0f/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:39.465133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.465419 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.465692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.497668 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] MFA Rules not processed for user `ea69e40ad5324b309eadc3580136cc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:39.499020 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:39.564967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1399/2815] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:39.569407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.633712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d76a7b-6739-435b-81db-a64b26acd025 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.639079 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.639739 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.640139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.640418 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.641152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.643084 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.753138 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1417/2816] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:39 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:39.754352 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.765536 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54081a76-d9c9-403f-856c-fb14fe52bc20 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.823261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.824016 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:39.824305 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:39.824583 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:39.825321 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:39.827286 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:39.975041 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1400/2817] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:39 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:39.976770 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:39.991159 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68714ee-3b82-4a18-94c9-0c56e55e3d2d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:39.999107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:39.999793 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.000077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.000349 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.001306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:40.002911 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:40.014181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1418/2818] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:40.025663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:40.037101 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a590795-d087-41d5-884b-43fbb9d871fb admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:40.043318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:40.044241 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.044532 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.044812 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] PATH_INFO: `/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f/users/941d51456462450aad4b6948d2289fda/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.062079 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d246c461a94cdbbaeaded6e9a62c4f, user_id=941d51456462450aad4b6948d2289fda, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:40.064769 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:40.140893 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1401/2819] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:40 2022] PUT /identity/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f/users/941d51456462450aad4b6948d2289fda/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:40.144970 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:40.156714 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55bd3b-6038-4248-b01e-7eab829bffa2 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:40.216716 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:40.217471 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.217762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.218044 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.218827 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:40.220482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f477e-a16f-45b0-87cf-5470bdefd298 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:40.231411 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1419/2820] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:40.235610 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:40.246144 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e98d83-f14b-423e-8f68-fa321e9a1ba4 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:40.251270 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:40.252181 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.252468 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.252747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] PATH_INFO: `/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f/users/941d51456462450aad4b6948d2289fda/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.254788 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d246c461a94cdbbaeaded6e9a62c4f, user_id=941d51456462450aad4b6948d2289fda, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:40.257589 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:40.269390 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1402/2821] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:40 2022] PUT /identity/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f/users/941d51456462450aad4b6948d2289fda/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:40.280575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873d05-6252-4605-8455-ddeca375291b None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.280861 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873d05-6252-4605-8455-ddeca375291b None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.281181 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13873d05-6252-4605-8455-ddeca375291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.308841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-13873d05-6252-4605-8455-ddeca375291b None None] MFA Rules not processed for user `941d51456462450aad4b6948d2289fda`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:40.310139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-13873d05-6252-4605-8455-ddeca375291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:40.383741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1420/2822] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:40.400063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:40.402573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:40.462210 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5b2a-b794-4ef1-af32-4742eda8b6af admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:40.466138 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:40.466783 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:40.467065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:40.467346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:40.476230 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:40.477692 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17a8d2-23e2-4e8f-bade-f1317ce32130 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:40.487422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1403/2823] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:41.824701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873d05-6252-4605-8455-ddeca375291b None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:41.885165 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13873d05-6252-4605-8455-ddeca375291b None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:41.890342 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:41.891211 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:41.891491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:41.891771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] PATH_INFO: `/v3/users/ea69e40ad5324b309eadc3580136cc0f` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:41.892969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea69e40ad5324b309eadc3580136cc0f)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:41.894969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:42.119632 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea69e40ad5324b309eadc3580136cc0f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:42.120291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea69e40ad5324b309eadc3580136cc0f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:42.127615 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea69e40ad5324b309eadc3580136cc0f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:42.220559 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea69e40ad5324b309eadc3580136cc0f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:42.221268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea69e40ad5324b309eadc3580136cc0f'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:42.241653 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1421/2824] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:41 2022] DELETE /identity/v3/users/ea69e40ad5324b309eadc3580136cc0f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:42.245847 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:42.246905 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:42.248111 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:42.276447 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:42.278580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:42.355973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1404/2825] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:09:42.366552 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:42.368160 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:42.438180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaa695-476e-4edc-92e0-0873ffe35d8a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:42.442616 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:42.443868 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:42.444158 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:42.444795 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:42.458598 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:42.460903 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:42.474287 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1422/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:42.883854 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:42.887014 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:42.899323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e996cd2-9bef-48e8-84e2-5d6d336a9ba4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:42.904577 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:42.905480 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:42.905750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:42.906028 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] PATH_INFO: `/v3/users/e6a24932d7894c199f1374b9203c3873` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:42.907202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a24932d7894c199f1374b9203c3873)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:42.909133 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:42.958832 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:42.960295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:42.975366 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8368a-f759-433c-ab3d-92655e458654 service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:42.980060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:42.980920 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:42.981323 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:42.982055 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] PATH_INFO: `/v3/projects/5933e0d5e7224a3788b15b71327d7b42` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:42.984313 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5933e0d5e7224a3788b15b71327d7b42)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:42.986139 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:43.188132 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5933e0d5e7224a3788b15b71327d7b42', 'request_id': 'req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.188344 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a24932d7894c199f1374b9203c3873'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.193343 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5933e0d5e7224a3788b15b71327d7b42', 'request_id': 'req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.194984 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a24932d7894c199f1374b9203c3873'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.195648 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a24932d7894c199f1374b9203c3873'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.294893 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5933e0d5e7224a3788b15b71327d7b42', 'request_id': 'req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.306256 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] The token cache is being invalidate because project 5933e0d5e7224a3788b15b71327d7b42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:43.310289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.310289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.310289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1423/2827] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:42 2022] DELETE /identity/v3/projects/5933e0d5e7224a3788b15b71327d7b42 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:43.313131 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:43.314407 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:43.375449 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b941b2-1b0a-48e9-87cd-fe16dc4f338e admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:43.380053 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:43.380909 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:43.381231 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:43.381504 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] PATH_INFO: `/v3/users/941d51456462450aad4b6948d2289fda` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:43.382701 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941d51456462450aad4b6948d2289fda)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:43.384618 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:43.385004 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a24932d7894c199f1374b9203c3873'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.385655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a24932d7894c199f1374b9203c3873'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.403846 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1405/2828] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:42 2022] DELETE /identity/v3/users/e6a24932d7894c199f1374b9203c3873 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:43.638591 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:43.640508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:43.664853 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941d51456462450aad4b6948d2289fda'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.665759 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941d51456462450aad4b6948d2289fda'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.675350 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941d51456462450aad4b6948d2289fda'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.708757 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2962dd-eb7b-48ca-9023-b3eaa7f2ca84 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:43.713414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:43.714281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:43.714567 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:43.714849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] PATH_INFO: `/v3/projects/25d111f002fe4df2afbc438cc7658c33` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:43.716729 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d111f002fe4df2afbc438cc7658c33)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:43.718707 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:43.756678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941d51456462450aad4b6948d2289fda'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.757419 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941d51456462450aad4b6948d2289fda'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.774855 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1424/2829] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:43 2022] DELETE /identity/v3/users/941d51456462450aad4b6948d2289fda => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:43.836955 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d111f002fe4df2afbc438cc7658c33', 'request_id': 'req-caf3e309-00e1-4831-b377-f9e816be1464'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.842728 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d111f002fe4df2afbc438cc7658c33', 'request_id': 'req-caf3e309-00e1-4831-b377-f9e816be1464'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.916656 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d111f002fe4df2afbc438cc7658c33', 'request_id': 'req-caf3e309-00e1-4831-b377-f9e816be1464'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.927851 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] The token cache is being invalidate because project 25d111f002fe4df2afbc438cc7658c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:43.928139 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.928765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:43.930339 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1406/2830] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:43 2022] DELETE /identity/v3/projects/25d111f002fe4df2afbc438cc7658c33 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:43.934294 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:43.935682 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.005636 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e833f8-a11e-4508-b273-f8d8f04d1204 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.062285 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.063161 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.063561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.063844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] PATH_INFO: `/v3/users/f90f6a5ed5904c88aafe98f49fa3756a` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.065118 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90f6a5ed5904c88aafe98f49fa3756a)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.067051 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.227470 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.228947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.242416 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3e309-00e1-4831-b377-f9e816be1464 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.247686 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.249120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.249617 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.250512 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] PATH_INFO: `/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.251837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d246c461a94cdbbaeaded6e9a62c4f)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.253998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.270353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90f6a5ed5904c88aafe98f49fa3756a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.271095 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90f6a5ed5904c88aafe98f49fa3756a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.278425 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90f6a5ed5904c88aafe98f49fa3756a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.362184 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90f6a5ed5904c88aafe98f49fa3756a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.362804 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-c45180fe-e2bb-4bf6-8b2c-c028500ac2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90f6a5ed5904c88aafe98f49fa3756a'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.367570 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d246c461a94cdbbaeaded6e9a62c4f', 'request_id': 'req-d7c67b8e-4393-4749-bdb6-523b3886bce4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.373253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d246c461a94cdbbaeaded6e9a62c4f', 'request_id': 'req-d7c67b8e-4393-4749-bdb6-523b3886bce4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.382052 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1425/2831] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:43 2022] DELETE /identity/v3/users/f90f6a5ed5904c88aafe98f49fa3756a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:44.442659 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d246c461a94cdbbaeaded6e9a62c4f', 'request_id': 'req-d7c67b8e-4393-4749-bdb6-523b3886bce4'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.454744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] The token cache is being invalidate because project 96d246c461a94cdbbaeaded6e9a62c4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:44.459315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.459315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-d7c67b8e-4393-4749-bdb6-523b3886bce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.459315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1407/2832] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:44 2022] DELETE /identity/v3/projects/96d246c461a94cdbbaeaded6e9a62c4f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:44.462851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.463170 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.463464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.481672 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:44.482919 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.541564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1426/2833] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:44.549822 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.550120 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.550405 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.568594 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:44.569921 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.578481 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1408/2834] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:44.582857 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.592587 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7d194-b8b1-4072-9965-e9080fe1da43 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.597953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.598626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.598908 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.599180 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.599906 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:44.600210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.601829 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.613324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1427/2835] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:09:44.617790 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.627056 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d11d9-2b24-4180-b749-9710fdaedb0b None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.632172 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.632835 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.633077 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.633217 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.633487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.634125 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.634800 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.636050 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.649197 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d099d-ea5d-4f52-8d3e-7da35f95c9df admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.653549 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.654403 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.654688 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.654962 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] PATH_INFO: `/v3/projects/30f022f76a04441ba58bd6fb91424698` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.656789 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f022f76a04441ba58bd6fb91424698)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.658811 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.735966 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1409/2836] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:44 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:44.739932 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.780148 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f022f76a04441ba58bd6fb91424698', 'request_id': 'req-b36e544f-a3da-407b-aba7-f2398e0b2df8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.785953 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f022f76a04441ba58bd6fb91424698', 'request_id': 'req-b36e544f-a3da-407b-aba7-f2398e0b2df8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.801290 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2c0d8-ab57-4ee2-8556-11e2d8b09b82 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.853821 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.854487 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.854764 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.855034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.855713 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.857654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.865353 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f022f76a04441ba58bd6fb91424698', 'request_id': 'req-b36e544f-a3da-407b-aba7-f2398e0b2df8'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.877575 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] The token cache is being invalidate because project 30f022f76a04441ba58bd6fb91424698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:44.878433 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.878590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:44.880144 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1428/2837] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:44 2022] DELETE /identity/v3/projects/30f022f76a04441ba58bd6fb91424698 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:44.940402 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1410/2838] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:44 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 13:09:44.944786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.946263 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:44.960455 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e544f-a3da-407b-aba7-f2398e0b2df8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:44.965325 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:44.966020 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:44.966306 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:44.966583 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:44.967337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:44.969745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:44.983881 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1429/2839] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:44.985319 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:44.996051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4990505-c3ad-4150-bcb1-9d972a6fd609 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:45.002318 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:45.003104 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.003525 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.004006 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.005297 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:45.008051 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549de06b-1fb4-404d-b721-2585b5bf1688 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:45.020755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1411/2840] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:45.025557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:45.037110 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41198d-4792-4d7d-a46f-4696e99c6588 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:45.045626 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:45.046540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.046907 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.047402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] PATH_INFO: `/v3/projects/3080de437dea4e72aff3645a5c4beeac/users/f88684137e89428aa11e70912e1cebc2/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.064991 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3080de437dea4e72aff3645a5c4beeac, user_id=f88684137e89428aa11e70912e1cebc2, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:45.067778 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:45.157891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1430/2841] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:45 2022] PUT /identity/v3/projects/3080de437dea4e72aff3645a5c4beeac/users/f88684137e89428aa11e70912e1cebc2/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:45.169145 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.169443 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.169750 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.196824 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] MFA Rules not processed for user `f88684137e89428aa11e70912e1cebc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:45.198065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:45.264177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1412/2842] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 13:09:45.275633 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:45.277346 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:45.334392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125cb4e-b828-4c55-b67d-142fcb48f048 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:45.338205 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:45.338849 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.339134 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.339415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.348415 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:45.349936 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28711d8-9979-417f-9eaa-8e0628c5f766 service cinder] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:45.358741 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1431/2843] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:45.378385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:45.439479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4f50d-06cf-4c36-ae29-5236458f2847 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:45.444025 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:45.444884 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.445202 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.445479 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] PATH_INFO: `/v3/users/f88684137e89428aa11e70912e1cebc2` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.446654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88684137e89428aa11e70912e1cebc2)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:45.448546 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:45.701919 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88684137e89428aa11e70912e1cebc2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:45.708825 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88684137e89428aa11e70912e1cebc2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:45.709571 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88684137e89428aa11e70912e1cebc2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:45.830557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88684137e89428aa11e70912e1cebc2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:45.831169 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88684137e89428aa11e70912e1cebc2'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:45.853326 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1413/2844] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:45 2022] DELETE /identity/v3/users/f88684137e89428aa11e70912e1cebc2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:45.857969 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:45.858257 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:45.858535 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:45.878191 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:45.880195 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:45.943273 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1432/2845] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:45.963310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:45.964722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:46.019885 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6427-ba08-4d00-b41b-3d35cdccd422 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:46.023701 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:46.024336 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.024618 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.024894 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.034323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:46.035742 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe26c9-91ac-40a7-9e4f-9a28b8f409c9 service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:46.044899 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1414/2846] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:46.484788 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:46.486551 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:46.500030 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a8258-1c72-4977-8780-52223778c20d None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:46.504955 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:46.506502 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.506786 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.507060 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] PATH_INFO: `/v3/projects/3080de437dea4e72aff3645a5c4beeac` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.508374 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3080de437dea4e72aff3645a5c4beeac)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:46.510531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:46.660008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3080de437dea4e72aff3645a5c4beeac', 'request_id': 'req-81100f56-5bef-4667-abe8-ae88a4d8eabe'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:46.665364 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3080de437dea4e72aff3645a5c4beeac', 'request_id': 'req-81100f56-5bef-4667-abe8-ae88a4d8eabe'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:46.779791 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3080de437dea4e72aff3645a5c4beeac', 'request_id': 'req-81100f56-5bef-4667-abe8-ae88a4d8eabe'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:46.792255 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] The token cache is being invalidate because project 3080de437dea4e72aff3645a5c4beeac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:46.792540 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:46.793186 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-81100f56-5bef-4667-abe8-ae88a4d8eabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:46.794713 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1433/2847] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:46 2022] DELETE /identity/v3/projects/3080de437dea4e72aff3645a5c4beeac => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:46.800271 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.800755 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.800858 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.817873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:46.819039 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:46.884399 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1415/2848] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:46.893534 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.893918 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.894210 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.916772 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:46.918174 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:46.926227 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1434/2849] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:46.930449 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:46.940596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94ae24-59bf-4d17-8a04-fe959e99fca4 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:46.945174 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:46.945823 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.946106 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.946380 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] PATH_INFO: `/v3/domains` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.947100 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91838) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:46.947409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:46.948998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:46.961032 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1416/2850] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:09:46.965268 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:46.974958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f66119-2ad0-4a21-a082-fc81e9428146 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:46.979630 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:46.980276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:46.980561 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:46.980841 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:46.981571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:46.983464 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.084295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1435/2851] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:46 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:47.088722 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.099360 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027fcf-895b-4777-903e-a93f4ce1840a admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.152345 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.153005 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.153320 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.153596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.154266 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.156784 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.254273 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1417/2852] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:47 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:47.258332 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.269291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24e8c0-d933-496c-bcd3-c929f892527f admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.274295 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.274947 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.275236 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.275513 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.276291 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.277926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.288248 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1436/2853] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:47.291944 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.301996 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49375cf9-c1f1-4b6a-81d7-0d4b5a3d701e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.306537 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.307196 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.307463 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.307735 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.308455 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.310063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96609431-00f1-404b-bf4b-6b8b8da36551 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.320285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1418/2854] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:47.324328 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.334807 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96612275-2baa-4719-89d8-d36dee66fa9a admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.339337 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.340200 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.340454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.340724 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] PATH_INFO: `/v3/projects/208c858a04e34feeb2fa298c1f163beb/users/9466ad66141f4a9aa44c49841ff254f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.355404 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=208c858a04e34feeb2fa298c1f163beb, user_id=9466ad66141f4a9aa44c49841ff254f5, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.358086 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.470745 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1437/2855] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:47 2022] PUT /identity/v3/projects/208c858a04e34feeb2fa298c1f163beb/users/9466ad66141f4a9aa44c49841ff254f5/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:47.482000 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.482295 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.482581 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.508502 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] MFA Rules not processed for user `9466ad66141f4a9aa44c49841ff254f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:47.509744 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:47.572328 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1419/2856] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:47.576930 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.638631 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a85d74-0a64-4ad9-ab68-f0e4e6051f3c admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.643453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.644114 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.644400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.644694 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.645408 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.647593 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.746895 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1438/2857] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:47 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:47.751719 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.762738 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35c61-1020-40bd-b68a-a1973de79531 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.818030 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.818774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.819074 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.819350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] PATH_INFO: `/v3/users` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.820034 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.822285 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.962233 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1420/2858] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:47 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:47.966147 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:47.977203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eccb32-da46-4184-8f1e-48ba3a3307bb admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:47.981712 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:47.982359 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:47.982641 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:47.982921 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:47.983637 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:47.986281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:47.996876 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1439/2859] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:48.000939 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:48.010557 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05238a0a-888b-4118-bb0c-d702567c821c admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:48.015160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:48.016131 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:48.016409 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:48.016679 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] PATH_INFO: `/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d/users/80e953a1dc014f89b8819c28ba54497e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:48.032739 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9458d6dbbeb04b9b98fc65b7b6764b4d, user_id=80e953a1dc014f89b8819c28ba54497e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:48.035404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:48.104807 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1421/2860] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:47 2022] PUT /identity/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d/users/80e953a1dc014f89b8819c28ba54497e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:48.108851 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:48.119301 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a008c-3b5d-4c90-adc5-5736f92a51c8 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:48.173590 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:48.174252 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:48.174537 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:48.174810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:48.175532 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:48.177145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef97750-ceb7-4598-97e8-d7bc50651c17 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:48.186720 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1440/2861] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 13:09:48.191623 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:48.201809 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074b5ac-445a-47b0-b928-dcc9225d719f admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:48.206804 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:48.207671 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:48.207948 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:48.208224 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] PATH_INFO: `/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d/users/80e953a1dc014f89b8819c28ba54497e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:48.210211 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9458d6dbbeb04b9b98fc65b7b6764b4d, user_id=80e953a1dc014f89b8819c28ba54497e, role_id=e3e67a5ff9c548a99cfb439bbde0e7d9)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:48.212873 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:48.223472 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1422/2862] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:48 2022] PUT /identity/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d/users/80e953a1dc014f89b8819c28ba54497e/roles/e3e67a5ff9c548a99cfb439bbde0e7d9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:48.285885 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:48.286218 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:48.286489 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:48.313531 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] MFA Rules not processed for user `80e953a1dc014f89b8819c28ba54497e`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:48.314757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:48.382096 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1441/2863] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:48.393998 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:48.395654 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:48.450578 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0920-d723-4a82-a78f-fb400a0cce17 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:48.455160 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:48.455782 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:48.456064 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:48.456341 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:48.509765 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:48.511130 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27b7b-b938-4815-bd92-a4385d2ce1c9 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:48.520452 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1423/2864] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:51.584757 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:51.644059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc84e0-5e0d-4a23-b2bd-e06a7b68ad12 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:51.648958 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:51.649843 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:51.650127 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:51.650400 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] PATH_INFO: `/v3/users/9466ad66141f4a9aa44c49841ff254f5` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:51.651607 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9466ad66141f4a9aa44c49841ff254f5)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:51.653576 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:51.976937 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9466ad66141f4a9aa44c49841ff254f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:51.977648 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9466ad66141f4a9aa44c49841ff254f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:51.984336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9466ad66141f4a9aa44c49841ff254f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:52.134009 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9466ad66141f4a9aa44c49841ff254f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:52.134640 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9466ad66141f4a9aa44c49841ff254f5'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:52.152518 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1442/2865] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:51 2022] DELETE /identity/v3/users/9466ad66141f4a9aa44c49841ff254f5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:52.157142 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:52.157634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:52.157917 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:52.175003 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:52.176191 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:52.232337 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1424/2866] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:52.243115 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:52.244482 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:52.300441 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4cbab-6fa1-4a13-b580-59066289385d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:52.304015 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:52.304655 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:52.304940 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:52.305250 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:52.314718 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:52.316135 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:52.325474 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1443/2867] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:09:53.021774 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:53.023540 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:53.036565 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261267d-1ecb-4e37-9651-a604f5a03348 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:53.044436 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:53.045771 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:53.046261 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:53.046675 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] PATH_INFO: `/v3/projects/208c858a04e34feeb2fa298c1f163beb` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:53.048077 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=208c858a04e34feeb2fa298c1f163beb)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:53.050508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:53.184923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208c858a04e34feeb2fa298c1f163beb', 'request_id': 'req-8040f9e4-079a-4393-a09c-4337d0d209cc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.190911 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208c858a04e34feeb2fa298c1f163beb', 'request_id': 'req-8040f9e4-079a-4393-a09c-4337d0d209cc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.270642 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208c858a04e34feeb2fa298c1f163beb', 'request_id': 'req-8040f9e4-079a-4393-a09c-4337d0d209cc'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.282752 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] The token cache is being invalidate because project 208c858a04e34feeb2fa298c1f163beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:53.283045 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.283682 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.285343 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1425/2868] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:53 2022] DELETE /identity/v3/projects/208c858a04e34feeb2fa298c1f163beb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:53.289317 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:53.298797 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e795e3-d65b-476d-a06b-3f9c87084dae service neutron] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:53.352562 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:53.353454 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:53.353732 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:53.354008 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] PATH_INFO: `/v3/users/80e953a1dc014f89b8819c28ba54497e` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:53.355201 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e953a1dc014f89b8819c28ba54497e)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:53.357203 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:53.684228 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e953a1dc014f89b8819c28ba54497e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.684894 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e953a1dc014f89b8819c28ba54497e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.692453 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e953a1dc014f89b8819c28ba54497e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.767961 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e953a1dc014f89b8819c28ba54497e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.768580 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-b76a42ec-9a2e-44f9-b6d0-01317e67cadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e953a1dc014f89b8819c28ba54497e'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:53.786230 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1444/2869] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:09:53 2022] DELETE /identity/v3/users/80e953a1dc014f89b8819c28ba54497e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:09:54.186401 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:54.187826 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:54.201420 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f9e4-079a-4393-a09c-4337d0d209cc admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:54.259256 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:54.260956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.260956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.260956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] PATH_INFO: `/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.261877 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9458d6dbbeb04b9b98fc65b7b6764b4d)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:54.263772 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:54.414329 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9458d6dbbeb04b9b98fc65b7b6764b4d', 'request_id': 'req-424c8a08-28e8-46db-a5cd-bb19ce546fa1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:54.419657 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9458d6dbbeb04b9b98fc65b7b6764b4d', 'request_id': 'req-424c8a08-28e8-46db-a5cd-bb19ce546fa1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:54.487947 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9458d6dbbeb04b9b98fc65b7b6764b4d', 'request_id': 'req-424c8a08-28e8-46db-a5cd-bb19ce546fa1'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:54.498634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] The token cache is being invalidate because project 9458d6dbbeb04b9b98fc65b7b6764b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91838) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:09:54.500350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:54.500350 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-424c8a08-28e8-46db-a5cd-bb19ce546fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:09:54.501670 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1426/2870] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:09:54 2022] DELETE /identity/v3/projects/9458d6dbbeb04b9b98fc65b7b6764b4d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:54.506498 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.506994 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.507103 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.526242 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:54.527450 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:54.591938 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1445/2871] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:54.599837 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.600128 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.600404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.618694 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:54.619874 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:54.628580 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1427/2872] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:54.632611 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:54.642522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04ddf8-8d67-4a9c-8278-ead8dd2babd9 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:54.647054 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:54.647959 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.648245 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.648522 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.649309 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91839) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 13:09:54.649620 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:54.651234 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:54.662926 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1446/2873] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 11 13:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 13:09:54.666957 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:54.676781 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95f1d7-a8f3-44aa-834e-d78bc98c314c None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:54.681414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:54.682053 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.682333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.682603 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] PATH_INFO: `/v3/projects` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.683275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:54.685165 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:54.775303 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1428/2874] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 11 13:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:54.779473 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:54.790018 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25800-ddd6-47d3-9232-1f18864933f1 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:54.845424 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:54.846121 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.846410 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.846687 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] PATH_INFO: `/v3/users` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.847595 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:54.849392 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:54.962289 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1447/2875] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 11 13:09:54 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 13:09:54.966545 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:54.977647 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42374c83-96e5-4d13-919e-62823121c265 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:54.982394 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:54.983092 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:54.983438 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:54.983740 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:54.984462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:54.986867 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:54.997253 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1429/2876] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:55.001625 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:55.011429 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326dcd3d-4d73-41c0-982c-c4291805e96d admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:55.015987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:55.017579 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:55.017870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:55.018145 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:55.018870 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:55.020452 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657699-2c7d-41d6-b1e9-feb2e3595a5a admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:55.030557 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1448/2877] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 11 13:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 13:09:55.034888 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:55.050814 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774d93c-9eaf-410a-a680-7d3f674bfe6e admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:55.055404 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:55.056281 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] REQUEST_METHOD: `PUT` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:55.056587 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:55.056863 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] PATH_INFO: `/v3/projects/2f0902f6e4f440248527f634b25c6755/users/bde359c7234a45e787c0a970c9602528/roles/b0bbf919a58b47ed9dae65f2ea7472f0` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:55.071608 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0902f6e4f440248527f634b25c6755, user_id=bde359c7234a45e787c0a970c9602528, role_id=b0bbf919a58b47ed9dae65f2ea7472f0)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:55.074291 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:55.150907 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1430/2878] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 11 13:09:55 2022] PUT /identity/v3/projects/2f0902f6e4f440248527f634b25c6755/users/bde359c7234a45e787c0a970c9602528/roles/b0bbf919a58b47ed9dae65f2ea7472f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 13:09:55.162845 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:55.167173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:55.167173 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:55.193019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] MFA Rules not processed for user `bde359c7234a45e787c0a970c9602528`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:09:55.194281 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:55.257762 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1449/2879] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:09:55.268923 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:09:55.270717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:09:55.326333 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051bcc6-dc15-4c5f-9a50-7fbbba520925 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:09:55.337093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eee618b771c149d98b108e389c511acf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:09:55.337093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:09:55.337093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:09:55.337093 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:09:55.340017 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:09:55.341500 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:09:55.350973 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1431/2880] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:09:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:10:05.707597 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:05.709810 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:05.814670 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65dd31-85ce-4d96-aaca-ba4d3b125318 None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:05.823644 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bd3d5788bc74f70a942f44f2f38dfca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:05.824468 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:05.824826 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:05.825238 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:05.827569 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:05.844402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:05.846214 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aaa19-f858-4ae9-a14f-afc40e2ce500 service nova] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:05.861338 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1450/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:10:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:10:07.024065 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:07.100465 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300651c-d69d-453a-9a42-70107deb98d3 service cinder] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:07.105693 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:07.106665 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:07.107022 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:07.107367 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] PATH_INFO: `/v3/users/bde359c7234a45e787c0a970c9602528` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:07.108653 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde359c7234a45e787c0a970c9602528)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:07.110942 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:07.473001 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde359c7234a45e787c0a970c9602528'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:07.480078 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde359c7234a45e787c0a970c9602528'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:07.480849 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde359c7234a45e787c0a970c9602528'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:07.586063 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde359c7234a45e787c0a970c9602528'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:07.586687 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde359c7234a45e787c0a970c9602528'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:07.607038 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1432/2882] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:10:07 2022] DELETE /identity/v3/users/bde359c7234a45e787c0a970c9602528 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:10:07.611763 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] REQUEST_METHOD: `POST` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:07.612324 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:07.612460 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:07.631059 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.auth.core [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] MFA Rules not processed for user `23e04c3e033e439eb610ce935a77da73`. Rule list: `[]` (Enabled: `True`). {{(pid=91839) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:10:07.634402 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:07.691143 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1451/2883] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 11 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:10:07.701428 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:07.703177 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:07.763422 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9f015-7745-4f6a-b4d5-93c70c7481e5 admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:07.766990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8e3bf8abe544a98ba074737674ab93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:07.767646 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:07.767925 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:07.768198 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:07.779185 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:07.780634 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21daabf-6393-44e7-9103-96485c3393bb service neutron] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:07.790871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1433/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 13:10:08.345730 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:08.347221 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:08.364272 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539904-81e6-4037-a1de-f25caea56cfb None None] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:08.370451 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:08.371321 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:08.371603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:08.371880 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] PATH_INFO: `/v3/projects/2f0902f6e4f440248527f634b25c6755` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:08.373152 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0902f6e4f440248527f634b25c6755)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:08.375069 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:08.497619 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0902f6e4f440248527f634b25c6755', 'request_id': 'req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:08.503491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0902f6e4f440248527f634b25c6755', 'request_id': 'req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:08.557196 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0902f6e4f440248527f634b25c6755', 'request_id': 'req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:08.578019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] The token cache is being invalidate because project 2f0902f6e4f440248527f634b25c6755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:10:08.578314 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:08.578956 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:08.580543 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1452/2885] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:10:08 2022] DELETE /identity/v3/projects/2f0902f6e4f440248527f634b25c6755 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:10:16.053871 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] REQUEST_METHOD: `POST` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:16.054346 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:16.054446 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:16.080747 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.auth.core [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] MFA Rules not processed for user `70f76bd2fb124f4f9ab3d05cc0146e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91838) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 13:10:16.081990 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:16.152508 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1434/2886] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 11 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 13:10:16.192678 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:16.194107 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:16.284912 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b74eec-a5c8-4e0a-9e58-d98456a71e27 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:16.290846 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4584309e6ee74080b5b3bc63eacdab4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:16.291485 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] REQUEST_METHOD: `GET` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:16.291771 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:16.292048 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:16.299844 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:16.350176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:16.350176 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1453/2887] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 11 13:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 13:10:25.168081 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:25.169717 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:25.275523 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7026926-8c8a-46fb-9a45-b252c4f38e83 None None] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:25.280098 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:25.280967 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:25.281275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:25.281548 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] PATH_INFO: `/v3/users/f9b818fa4ac442cc9b07b0e545560409` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:25.282734 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b818fa4ac442cc9b07b0e545560409)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:25.284643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:25.586513 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b818fa4ac442cc9b07b0e545560409'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:25.593573 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b818fa4ac442cc9b07b0e545560409'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:25.594248 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b818fa4ac442cc9b07b0e545560409'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:25.669935 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b818fa4ac442cc9b07b0e545560409'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:25.670553 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b818fa4ac442cc9b07b0e545560409'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:25.688323 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1435/2888] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:10:25 2022] DELETE /identity/v3/users/f9b818fa4ac442cc9b07b0e545560409 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:10:25.969491 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:25.981093 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac085-7285-4894-8d97-cecd23441581 service swift] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:26.047564 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:26.048428 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:26.048722 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:26.048998 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] PATH_INFO: `/v3/projects/b5a2dd2508944a3294061456a0a16b04` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:26.050267 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a2dd2508944a3294061456a0a16b04)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:26.052254 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:26.189643 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a2dd2508944a3294061456a0a16b04', 'request_id': 'req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.195539 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a2dd2508944a3294061456a0a16b04', 'request_id': 'req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.281571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a2dd2508944a3294061456a0a16b04', 'request_id': 'req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.293111 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] The token cache is being invalidate because project b5a2dd2508944a3294061456a0a16b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:10:26.293399 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.294019 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.295571 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1454/2889] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:10:25 2022] DELETE /identity/v3/projects/b5a2dd2508944a3294061456a0a16b04 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:10:26.299866 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:26.301374 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:26.315596 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd980d-ec4e-474c-a066-62e8de42283b admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:26.370840 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:26.371754 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:26.372037 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:26.372310 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] PATH_INFO: `/v3/users/717504ab1b824187a32ba621c4568f45` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:26.373598 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=717504ab1b824187a32ba621c4568f45)` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:26.375582 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:26.557655 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717504ab1b824187a32ba621c4568f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.564275 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717504ab1b824187a32ba621c4568f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.564956 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717504ab1b824187a32ba621c4568f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.629965 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717504ab1b824187a32ba621c4568f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.630643 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.notifications [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717504ab1b824187a32ba621c4568f45'} {{(pid=91838) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:26.649021 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1436/2890] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 11 13:10:26 2022] DELETE /identity/v3/users/717504ab1b824187a32ba621c4568f45 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:10:26.901574 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Authenticating user token {{(pid=91839) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:10:26.903336 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.fernet_utils [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91839) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:10:26.915896 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3856e-bfeb-4c3b-ab73-c37f45c95913 admin admin] Validating token access rules against request {{(pid=91839) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:10:26.975398 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23e04c3e033e439eb610ce935a77da73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ea94fb17e4549a0aa68e4ab8008eb33', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91839) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:10:26.976646 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:10:26.976987 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:10:26.977300 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] PATH_INFO: `/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3` {{(pid=91839) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:10:26.978481 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a36ed3bea39f4ca1b01b18665ce66eb3)` {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:10:26.980369 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] RBAC: Authorization granted {{(pid=91839) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:10:27.081942 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a36ed3bea39f4ca1b01b18665ce66eb3', 'request_id': 'req-a2fee5de-3082-410e-b9ec-20cef936c792'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:27.091199 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a36ed3bea39f4ca1b01b18665ce66eb3', 'request_id': 'req-a2fee5de-3082-410e-b9ec-20cef936c792'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:27.161382 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a36ed3bea39f4ca1b01b18665ce66eb3', 'request_id': 'req-a2fee5de-3082-410e-b9ec-20cef936c792'} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:27.172603 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] The token cache is being invalidate because project a36ed3bea39f4ca1b01b18665ce66eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91839) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 13:10:27.172891 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:27.173548 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: DEBUG keystone.notifications [None req-a2fee5de-3082-410e-b9ec-20cef936c792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91839) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 13:10:27.175276 dv-cinder-837699-4-iscsi devstack@keystone.service[91839]: [pid: 91839|app: 0|req: 1455/2891] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 11 13:10:26 2022] DELETE /identity/v3/projects/a36ed3bea39f4ca1b01b18665ce66eb3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 13:12:27.297963 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Authenticating user token {{(pid=91838) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 13:12:27.299385 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:12:27.386035 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049ebb-0b58-4b2f-b11f-37f7a29c57fe admin admin] Validating token access rules against request {{(pid=91838) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 13:12:27.441462 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23d5c01936db49eea09a70c2c5852238', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6ad72030e9a4999bbd7aad0cba0d4b8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91838) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 13:12:27.442107 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] REQUEST_METHOD: `GET` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 13:12:27.442389 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] SCRIPT_NAME: `/identity` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 13:12:27.442663 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91838) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 13:12:27.444414 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.fernet_utils [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91838) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 13:12:27.455700 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 13:12:27.457315 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ae255-d4f9-4c81-836a-bd9cc95907a3 service placement] RBAC: Authorization granted {{(pid=91838) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 13:12:27.467613 dv-cinder-837699-4-iscsi devstack@keystone.service[91838]: [pid: 91838|app: 0|req: 1437/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 11 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)